Jul 09 16:53:58 devstack cinder-volume[75543]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:53:58 devstack cinder-volume[75543]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:53:58 devstack cinder-volume[75543]: we strongly recommend against using it for new projects. Jul 09 16:53:58 devstack cinder-volume[75543]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:53:58 devstack cinder-volume[75543]: framework. For more detail see Jul 09 16:53:58 devstack cinder-volume[75543]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:53:58 devstack cinder-volume[75543]: import eventlet # noqa Jul 09 16:54:00 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:54:00 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:54:00 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:54:01 devstack cinder-volume[75543]: INFO dbcounter [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Registered counter for database cinder Jul 09 16:54:01 devstack cinder-volume[75543]: DEBUG oslo_db.sqlalchemy.engines [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:54:02 devstack cinder-volume[75543]: DEBUG dbcounter [-] [75543] Writer thread running {{(pid=75543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:54:02 devstack cinder-volume[75543]: INFO cinder.rpc [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:54:02 devstack cinder-volume[75543]: INFO cinder.rpc [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:54:02 devstack cinder-volume[75543]: DEBUG oslo_db.sqlalchemy.engines [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:54:02 devstack cinder-volume[75543]: INFO cinder.volume.manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Determined volume DB was empty at startup. Jul 09 16:54:02 devstack cinder-volume[75543]: DEBUG cinder.volume.manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75543) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:54:02 devstack cinder-volume[75543]: INFO cinder.volume.manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 16:54:02 devstack cinder-volume[75543]: WARNING stevedore.named [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:54:02 devstack cinder-volume[75543]: WARNING castellan.key_manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:54:02 devstack cinder-volume[75543]: WARNING cinder.keymgr.conf_key_mgr [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:54:02 devstack cinder-volume[75543]: DEBUG cinder.volume.drivers.lvm [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75543) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 16:54:02 devstack cinder-volume[75543]: DEBUG oslo_concurrency.processutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_concurrency.processutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.483s {{(pid=75543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_db.sqlalchemy.engines [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:54:03 devstack cinder-volume[75543]: INFO cinder.rpc [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 16:54:03 devstack cinder-volume[75543]: INFO cinder.rpc [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 16:54:03 devstack cinder-volume[75543]: WARNING stevedore.named [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:54:03 devstack cinder-volume[75543]: WARNING castellan.key_manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:54:03 devstack cinder-volume[75543]: INFO cinder.volume.manager [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_db.sqlalchemy.engines [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:54:03 devstack cinder-volume[75543]: INFO oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Starting 1 workers Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Started child 75711 {{(pid=75543) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Full set of CONF: {{(pid=75543) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] ******************************************************************************** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Configuration options gathered from: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] ================================================================================ {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] allow_availability_zone_fallback = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] allow_compression_on_image_upload = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] allowed_direct_url_schemes = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] api_rate_limit = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] auth_strategy = keystone {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] az_cache_duration = 3600 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_availability_zone = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_host = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_stats_polling_interval = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backup_api_class = cinder.backup.api.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backup_name_template = backup-%s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backup_use_same_host = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backup_use_temp_snapshot = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] chap_password = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75711]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] chap_username = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_internal_tenant_project_id = 0962d8731bf148a4b9b5d41af8209617 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_internal_tenant_user_id = 7a7ae2a79c0e4489a2f90a7e990f8115 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cloned_volume_same_az = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cluster = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] compression_format = gzip {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] config_dir = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] config_source = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] control_exchange = openstack {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] debug = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] default_availability_zone = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] default_group_type = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] default_volume_type = lvmdriver-1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] disk_geometry = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_client_cert = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_client_cert_key = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_data_namespace = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_ssl_cert_path = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_ssl_cert_verify = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] driver_use_ssl = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] enable_force_upload = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] enable_new_services = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] enable_unsupported_driver = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] enforce_multipath_for_image_xfer = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] filter_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_api_insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_api_ssl_compression = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_ca_certificates_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_num_retries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance_request_timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] goodness_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] graceful_shutdown_timeout = 5 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] group_api_class = cinder.group.api.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] host = devstack {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_compress_on_upload = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_conversion_address_space_limit = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_conversion_cpu_limit = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_conversion_disable = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_upload_use_cinder_backend = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_upload_use_internal_tenant = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_volume_cache_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_volume_cache_max_count = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] init_host_max_objects_retrieval = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] instance_format = [instance: %(uuid)s] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iscsi_target_flags = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iscsi_write_cache = on {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iser_helper = tgtadm {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iser_ip_address = 192.168.122.125 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iser_port = 3260 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_color = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_config_append = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_dir = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_options = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_rotate_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_rotate_interval_type = days {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] log_rotation_type = none {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] max_age = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] max_logfile_count = 30 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] max_logfile_size_mb = 200 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] max_over_subscription_ratio = 20.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] message_reap_interval = 86400 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] message_ttl = 2592000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] monkey_patch = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] monkey_patch_modules = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] my_ip = 192.168.122.125 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] no_snapshot_gb_quota = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] num_iser_scan_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] num_shell_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] num_volume_device_scan_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] nvmeof_conn_info_version = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] nvmet_ns_id = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] nvmet_port_id = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_max_limit = 1000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_ext_list = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_listen_port = 8776 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_use_ssl = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] osapi_volume_workers = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] per_volume_size_limit = -1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] periodic_fuzzy_delay = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] periodic_interval = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] public_endpoint = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] publish_errors = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_backup_gigabytes = 1000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_backups = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_gigabytes = 1000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_groups = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_snapshots = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] quota_volumes = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] rate_limit_burst = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] rate_limit_except_level = CRITICAL {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] rate_limit_interval = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] reinit_driver_count = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] replication_device = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] report_discard_supported = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] report_interval = 120 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] reservation_clean_interval = 86400 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] reservation_expire = 86400 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] reserved_image_namespaces = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] reserved_percentage = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] rpc_response_timeout = 120 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] run_external_periodic_tasks = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] scst_target_driver = iscsi {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] scst_target_iqn_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_down_time = 720 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] shell_completion = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] snapshot_name_template = snapshot-%s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] snapshot_same_host = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] split_loggers = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] state_path = /opt/stack/data/cinder {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] storage_availability_zone = nova {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] storage_protocol = iSCSI {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] syslog_log_facility = LOG_USER {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_helper = lioadm {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_ip_address = 192.168.122.125 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_port = 3260 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_protocol = iscsi {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] target_secondary_ip_addresses = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] trace_flags = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] transport_url = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] until_refresh = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_chap_auth = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_default_quota_class = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75711]: INFO cinder.volume.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_journal = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_json = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_multipath_for_image_xfer = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_stderr = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] use_syslog = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] verify_glance_signatures = enabled {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_api_class = cinder.volume.api.API {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_backend_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_clear = zero {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_clear_ionice = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_clear_size = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_copy_bps_limit = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_dd_blocksize = 1M {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_name_template = volume-%s {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_service_inithost_offload = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volume_usage_audit_period = month {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] zoning_mode = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.auth_section = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.auth_type = password {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.auth_version = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.cache = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.interface = public {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_password = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcache_username = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.region_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.service_type = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.backend = dogpile.cache.null {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.backend_argument = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.backend_expiration_time = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.config_prefix = cache.oslo {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.debug_cache_backend = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.enable_retry_client = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.enable_socket_keepalive = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.expiration_time = 600 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_dead_retry = 300 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_sasl_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.password = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.proxies = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.redis_db = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.redis_server = localhost:6379 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.retry_attempts = 2 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.retry_delay = 0.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.socket_keepalive_count = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.socket_keepalive_idle = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.socket_keepalive_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.socket_timeout = 1.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.tls_allowed_ciphers = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.tls_cafile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.tls_certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.tls_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.tls_keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cache.username = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] coordination.backend_url = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.asyncio_connection = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.asyncio_slave_connection = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.backend = sqlalchemy {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.connection = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.connection_debug = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.connection_parameters = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.connection_recycle_time = 3600 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.connection_trace = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.db_inc_retry_interval = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.db_max_retries = 20 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.db_max_retry_interval = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.db_retry_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.max_overflow = 50 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.max_pool_size = 5 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.max_retries = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.pool_timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.retry_interval = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.slave_connection = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.sqlite_synchronous = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.synchronous_reader = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] database.use_db_reconnect = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.connection_string = messaging:// {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.es_doc_type = notification {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.es_scroll_size = 10000 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.es_scroll_time = 2m {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.filter_error_trace = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.hmac_keys = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.sentinel_service_name = mymaster {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.socket_timeout = 0.1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.trace_requests = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler.trace_sqlalchemy = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler_jaeger.process_tags = {} {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] profiler_otlp.service_name_prefix = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.enforce_scope = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.policy_default_rule = default {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.group = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.helper_command = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] privsep_osbrick.user = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.group = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.helper_command = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] cinder_sys_admin.user = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.auth_section = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.auth_type = password {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.cafile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.collect_timing = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.send_service_user_token = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.split_loggers = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] service_user.timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.auth_section = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.auth_type = password {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.collect_timing = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.region_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.split_loggers = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] glance.timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.backend_availability_zone = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.chap_password = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.chap_username = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.disk_geometry = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_client_cert = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_data_namespace = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.driver_use_ssl = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.extra_capabilities = {} {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.filter_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.goodness_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iscsi_target_flags = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iser_port = 3260 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.lvm_share_target = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.lvm_type = auto {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.replication_device = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.report_discard_supported = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_helper = tgtadm {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_port = 3260 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_protocol = iscsi {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.trace_flags = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.use_chap_auth = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_backend_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_clear = zero {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_reports.file_event_handler = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_reports.log_dir = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.backend_host = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.chap_password = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.chap_username = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.disk_geometry = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.filter_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.goodness_function = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iser_helper = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iser_port = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.lvm_type = auto {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.replication_device = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.storage_protocol = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_ip_address = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_port = 3260 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.trace_flags = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_clear = zero {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] lvmdriver-1.volumes_dir = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_notifications.driver = [] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack sudo[75716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] key_manager.fixed_key = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.barbican_api_version = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.barbican_endpoint = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack sudo[75716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.barbican_endpoint_type = public {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.barbican_region_name = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.cafile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.collect_timing = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.number_of_retries = 60 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.retry_delay = 1 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.send_service_user_token = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.split_loggers = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.verify_ssl = True {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican.verify_ssl_path = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.auth_section = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.auth_type = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.cafile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.certfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.collect_timing = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.insecure = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.keyfile = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.split_loggers = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] barbican_service_user.timeout = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.approle_role_id = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.approle_secret_id = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.kv_mountpoint = secret {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.kv_path = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.kv_version = 2 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.namespace = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.root_token_id = **** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.ssl_ca_crt_file = None {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.timeout = 60.0 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.use_ssl = False {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:54:03 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] ******************************************************************************** {{(pid=75543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:54:04 devstack sudo[75716]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.735s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:04 devstack sudo[75852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:04 devstack sudo[75852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:04 devstack sudo[75852]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.693s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:54:04 devstack cinder-volume[75711]: INFO cinder.brick.local_dev.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:04 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:04 devstack sudo[76075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:04 devstack sudo[76075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:05 devstack sudo[76075]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:05 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:05 devstack cinder-volume[75711]: DEBUG cinder.brick.local_dev.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75711) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 16:54:05 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:05 devstack sudo[76281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:05 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:06 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:06 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.218s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:06 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:06 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:06 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:06 devstack sudo[76476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:06 devstack sudo[76476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:07 devstack sudo[76476]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:07 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.723s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:07 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:07 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:07 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:07 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 16:54:07 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:08 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:08 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.713s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:08 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:08 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:08 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:09 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:09 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.937s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:09 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:09 devstack sudo[76511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:09 devstack sudo[76511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:10 devstack sudo[76511]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:10 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.888s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:10 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:10 devstack sudo[76516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:10 devstack sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:10 devstack sudo[76516]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:10 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:10 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:10 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:10 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:11 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:11 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:11 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:11 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:11 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:11 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:11 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:12 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:12 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:12 devstack cinder-volume[75711]: INFO cinder.volume.drivers.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 16:54:12 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:12 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:12 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:12 devstack sudo[76542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:12 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:13 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.746s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:13 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:54:13 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:13 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:13 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack cinder-volume[75543]: DEBUG dbcounter [-] [75543] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:54:13 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:13 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:13 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:13 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:13 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:14 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:14 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:14 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:14 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:14 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:14 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:14 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:14 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:14 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:14 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:15 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:15 devstack cinder-volume[75711]: INFO cinder.volume.driver [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG cinder.volume.driver [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75711) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG oslo_db.sqlalchemy.engines [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75711) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writer thread running {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG cinder.db.api [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Building query based on filter {{(pid=75711) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG cinder.image.image_utils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75711) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:54:15 devstack cinder-volume[75711]: INFO cinder.keymgr.migration [None req-ef0c724c-13af-481a-9a38-f670b13af51d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:54:15 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:15 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:15 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:16 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:16 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:16 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:16 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:16 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:17 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:17 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:17 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:17 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:17 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:17 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:17 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:17 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:17 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:17 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:18 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG cinder.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Notifying Schedulers of capabilities ... {{(pid=75711) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:18 devstack cinder-volume[75711]: INFO cinder.volume.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Driver initialization completed successfully. Jul 09 16:54:18 devstack cinder-volume[75711]: INFO cinder.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Initiating service 2 cleanup Jul 09 16:54:18 devstack cinder-volume[75711]: INFO cinder.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Service 2 cleanup completed. Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG cinder.service [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Creating RPC server for service cinder-volume {{(pid=75711) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG cinder.service [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75711) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:54:18 devstack cinder-volume[75711]: INFO cinder.volume.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:54:18 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:18 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:54:18 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:19 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:19 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:19 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:19 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:19 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:20 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:20 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:20 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:20 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:54:20 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:20 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:20 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:20 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:20 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:54:20 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:21 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:21 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:21 devstack cinder-volume[75711]: INFO cinder.volume.manager [None req-c9252747-8ad6-428e-a7d5-fbfa616dbfe3 None None] Driver post RPC initialization completed successfully. Jul 09 16:54:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:54:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:54:32 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager._thread_info {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:54:32 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread count: 6 {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:54:32 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread info: [<_MainThread(MainThread, started 126917397016704)>, , , , , ] {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:55:32 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:55:32 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:55:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:32 devstack sudo[79401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:55:32 devstack sudo[79401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:32 devstack sudo[79401]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:33 devstack sudo[79404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:55:33 devstack sudo[79404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:33 devstack sudo[79404]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:33 devstack sudo[79409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:55:33 devstack sudo[79409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:34 devstack sudo[79409]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:34 devstack sudo[79564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:55:34 devstack sudo[79564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:34 devstack sudo[79564]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG cinder.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Notifying Schedulers of capabilities ... {{(pid=75711) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager._thread_info {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread count: 6 {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:55:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread info: [<_MainThread(MainThread, started 126917397016704)>, , , , , ] {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:56:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:SELECT=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:56:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:UPDATE=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:56:32 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:56:32 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:56:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:32 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:56:32 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:32 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:33 devstack sudo[82612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:56:33 devstack sudo[82612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:33 devstack sudo[82612]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:33 devstack sudo[82617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:56:33 devstack sudo[82617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:34 devstack sudo[82617]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:34 devstack sudo[82626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:56:34 devstack sudo[82626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:34 devstack sudo[82626]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG cinder.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Notifying Schedulers of capabilities ... {{(pid=75711) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager._thread_info {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread count: 6 {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:56:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread info: [<_MainThread(MainThread, started 126917397016704)>, , , , , ] {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:57:32 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:57:32 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:57:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:57:32 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:57:32 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:57:33 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Jul 09 16:57:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:57:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:57:33 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:57:33 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:57:33 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Jul 09 16:57:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:57:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:57:33 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:57:33 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:57:34 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Jul 09 16:57:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:57:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:57:34 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:57:34 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:57:35 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Jul 09 16:57:35 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:57:35 devstack cinder-volume[75711]: DEBUG cinder.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Notifying Schedulers of capabilities ... {{(pid=75711) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:57:35 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager._thread_info {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:57:35 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread count: 6 {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:57:35 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread info: [<_MainThread(MainThread, started 126917397016704)>, , , , , ] {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:58:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:SELECT=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:58:31 devstack cinder-volume[75711]: DEBUG dbcounter [-] [75711] Writing DB stats cinder:UPDATE=1 {{(pid=75711) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:58:32 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:58:32 devstack cinder-volume[75711]: DEBUG cinder.volume.drivers.lvm [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Updating volume stats {{(pid=75711) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 16:58:32 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:32 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:58:32 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:32 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:33 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:58:33 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:33 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:33 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:33 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:58:33 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:34 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:34 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:58:34 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:34 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG oslo_concurrency.processutils [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75711) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG cinder.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Notifying Schedulers of capabilities ... {{(pid=75711) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG oslo_service.periodic_task [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] Running periodic task VolumeManager._thread_info {{(pid=75711) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread count: 6 {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:58:34 devstack cinder-volume[75711]: DEBUG cinder.volume.manager [None req-3812d18b-cb6e-48d5-8b20-f9a97a319bed None None] thread info: [<_MainThread(MainThread, started 126917397016704)>, , , , , ] {{(pid=75711) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:58:38 devstack cinder-volume[75543]: INFO oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Caught SIGTERM, stopping children Jul 09 16:58:38 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Acquiring lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:38 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Acquired lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:38 devstack cinder-volume[75543]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Releasing lock "singleton_lock" {{(pid=75543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:38 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Stop services. {{(pid=75543) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 16:58:38 devstack cinder-volume[75543]: DEBUG oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Killing children. {{(pid=75543) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 16:58:38 devstack cinder-volume[75543]: INFO oslo_service.backend._eventlet.service [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Waiting on 1 children to exit Jul 09 16:58:43 devstack cinder-volume[75711]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 09 16:58:43 devstack cinder-volume[75711]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Acquiring lock "singleton_lock" {{(pid=75711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:43 devstack cinder-volume[75711]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Acquired lock "singleton_lock" {{(pid=75711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:43 devstack cinder-volume[75711]: DEBUG oslo_concurrency.lockutils [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Releasing lock "singleton_lock" {{(pid=75711) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:43 devstack cinder-volume[75711]: WARNING amqp [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:58:43 devstack cinder-volume[75711]: WARNING amqp [None req-f6d392a0-1ed6-4c2e-b814-f489167107a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:58:43 devstack cinder-volume[86260]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:58:43 devstack cinder-volume[86260]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:58:43 devstack cinder-volume[86260]: we strongly recommend against using it for new projects. Jul 09 16:58:43 devstack cinder-volume[86260]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:58:43 devstack cinder-volume[86260]: framework. For more detail see Jul 09 16:58:43 devstack cinder-volume[86260]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:58:43 devstack cinder-volume[86260]: import eventlet # noqa Jul 09 16:58:45 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:45 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:45 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:46 devstack cinder-volume[86260]: INFO dbcounter [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Registered counter for database cinder Jul 09 16:58:46 devstack cinder-volume[86260]: DEBUG oslo_db.sqlalchemy.engines [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:46 devstack cinder-volume[86260]: DEBUG dbcounter [-] [86260] Writer thread running {{(pid=86260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:58:46 devstack cinder-volume[86260]: INFO cinder.rpc [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:58:46 devstack cinder-volume[86260]: INFO cinder.rpc [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_db.sqlalchemy.engines [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:47 devstack cinder-volume[86260]: INFO cinder.volume.manager [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Determined volume DB was empty at startup. Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG cinder.volume.manager [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86260) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:58:47 devstack cinder-volume[86260]: INFO cinder.volume.manager [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 16:58:47 devstack cinder-volume[86260]: WARNING stevedore.named [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:58:47 devstack cinder-volume[86260]: WARNING castellan.key_manager [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:58:47 devstack cinder-volume[86260]: WARNING cinder.keymgr.conf_key_mgr [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:58:47 devstack cinder-volume[86260]: INFO cinder.volume.manager [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_db.sqlalchemy.engines [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:47 devstack cinder-volume[86260]: INFO oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Starting 1 workers Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Started child 86479 {{(pid=86260) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Full set of CONF: {{(pid=86260) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] ******************************************************************************** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Configuration options gathered from: {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] ================================================================================ {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] allow_availability_zone_fallback = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] allow_compression_on_image_upload = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] allowed_direct_url_schemes = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] api_rate_limit = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] auth_strategy = keystone {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_availability_zone = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86479]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_host = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_stats_polling_interval = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backup_api_class = cinder.backup.api.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backup_name_template = backup-%s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backup_use_same_host = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backup_use_temp_snapshot = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] chap_password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] chap_username = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_internal_tenant_project_id = 0962d8731bf148a4b9b5d41af8209617 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_internal_tenant_user_id = 7a7ae2a79c0e4489a2f90a7e990f8115 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cluster = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] compression_format = gzip {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] compute_api_class = cinder.compute.nova.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] config_dir = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] config_source = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] control_exchange = openstack {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] debug = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] default_availability_zone = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] default_group_type = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] default_volume_type = QuobyteHD {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] disk_geometry = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_client_cert = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_client_cert_key = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_data_namespace = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_ssl_cert_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_ssl_cert_verify = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] driver_use_ssl = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] enable_new_services = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] enable_unsupported_driver = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] enabled_backends = ['QuobyteHD'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] enforce_multipath_for_image_xfer = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] filter_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_api_insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_api_ssl_compression = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_ca_certificates_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_catalog_info = image:glance:publicURL {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_num_retries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance_request_timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] goodness_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] graceful_shutdown_timeout = 5 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] group_api_class = cinder.group.api.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] host = devstack {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_compress_on_upload = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_conversion_address_space_limit = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_conversion_cpu_limit = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_conversion_disable = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_upload_use_cinder_backend = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_upload_use_internal_tenant = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_volume_cache_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_volume_cache_max_count = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] image_volume_cache_max_size_gb = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] init_host_max_objects_retrieval = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] instance_format = [instance: %(uuid)s] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iscsi_target_flags = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iscsi_write_cache = on {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iser_helper = tgtadm {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iser_ip_address = 192.168.122.125 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iser_port = 3260 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_color = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_config_append = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_dir = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_options = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_rotate_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_rotate_interval_type = days {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] log_rotation_type = none {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.remotefs [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86479) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] max_age = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] max_logfile_count = 30 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] max_logfile_size_mb = 200 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] max_over_subscription_ratio = 20.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] message_reap_interval = 86400 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] message_ttl = 2592000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] migration_create_volume_timeout_secs = 300 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] monkey_patch = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] monkey_patch_modules = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] my_ip = 192.168.122.125 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] no_snapshot_gb_quota = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] num_iser_scan_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] num_shell_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] num_volume_device_scan_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] nvmeof_conn_info_version = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] nvmet_ns_id = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] nvmet_port_id = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_max_limit = 1000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_ext_list = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_listen_port = 8776 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_use_ssl = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] osapi_volume_workers = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] per_volume_size_limit = -1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] periodic_fuzzy_delay = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] periodic_interval = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] public_endpoint = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] publish_errors = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_backup_gigabytes = 1000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_backups = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_gigabytes = 1000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_groups = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_snapshots = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] quota_volumes = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] rate_limit_burst = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] rate_limit_except_level = CRITICAL {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] rate_limit_interval = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] reinit_driver_count = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] replication_device = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] report_discard_supported = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] report_interval = 120 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] reservation_clean_interval = 86400 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] reservation_expire = 86400 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] reserved_image_namespaces = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] reserved_percentage = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] rpc_response_timeout = 120 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] run_external_periodic_tasks = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] scst_target_driver = iscsi {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] scst_target_iqn_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_down_time = 720 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] shell_completion = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] snapshot_name_template = snapshot-%s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] split_loggers = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] state_path = /opt/stack/data/cinder {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] storage_availability_zone = nova {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] storage_protocol = iSCSI {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] syslog_log_facility = LOG_USER {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_helper = lioadm {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_ip_address = 192.168.122.125 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_port = 3260 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_protocol = iscsi {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] target_secondary_ip_addresses = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] trace_flags = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] transport_url = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] until_refresh = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_chap_auth = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_default_quota_class = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_journal = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_json = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_multipath_for_image_xfer = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_stderr = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] use_syslog = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] verify_glance_signatures = enabled {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_api_class = cinder.volume.api.API {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_backend_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_clear = zero {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_clear_ionice = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_clear_size = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_copy_bps_limit = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_dd_blocksize = 1M {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_name_template = volume-%s {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_service_inithost_offload = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volume_usage_audit_period = month {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] zoning_mode = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_concurrency.disable_process_locking = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.auth_section = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.auth_type = password {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.auth_version = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.cache = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.include_service_catalog = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.interface = public {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_password = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcache_username = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.region_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.service_type = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.backend = dogpile.cache.null {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.backend_argument = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.backend_expiration_time = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.config_prefix = cache.oslo {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.debug_cache_backend = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.enable_retry_client = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.enable_socket_keepalive = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.expiration_time = 600 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.hashclient_retry_attempts = 2 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_dead_retry = 300 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_pool_maxsize = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_sasl_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.proxies = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.redis_db = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.redis_server = localhost:6379 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.retry_attempts = 2 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.retry_delay = 0.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.socket_keepalive_count = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.socket_keepalive_idle = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.socket_keepalive_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.socket_timeout = 1.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86479) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 16:58:47 devstack cinder-volume[86479]: WARNING cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 16:58:47 devstack cinder-volume[86479]: WARNING cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.tls_allowed_ciphers = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.tls_cafile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.tls_certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.tls_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.tls_keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cache.username = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] coordination.backend_url = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.asyncio_connection = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.asyncio_slave_connection = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.backend = sqlalchemy {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.connection = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.connection_debug = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.connection_parameters = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.connection_recycle_time = 3600 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.connection_trace = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.db_inc_retry_interval = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.db_max_retries = 20 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.db_max_retry_interval = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.db_retry_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.max_overflow = 50 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.max_pool_size = 5 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.max_retries = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.mysql_wsrep_sync_wait = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.pool_timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.retry_interval = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.slave_connection = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.sqlite_synchronous = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.synchronous_reader = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] database.use_db_reconnect = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.connection_string = messaging:// {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.es_doc_type = notification {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.es_scroll_size = 10000 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.es_scroll_time = 2m {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.filter_error_trace = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.hmac_keys = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.sentinel_service_name = mymaster {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.socket_timeout = 0.1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.trace_requests = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler.trace_sqlalchemy = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler_jaeger.process_tags = {} {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler_jaeger.service_name_prefix = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] profiler_otlp.service_name_prefix = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.enforce_new_defaults = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.enforce_scope = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.policy_default_rule = default {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.policy_file = policy.yaml {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.group = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.helper_command = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] privsep_osbrick.user = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.group = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.helper_command = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] cinder_sys_admin.user = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.auth_section = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.auth_type = password {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.cafile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.collect_timing = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.send_service_user_token = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.split_loggers = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] service_user.timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.auth_section = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.auth_type = password {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.collect_timing = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.region_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.split_loggers = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] glance.timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.backend_availability_zone = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.chap_password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.chap_username = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack quobyte-client[86480]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.disk_geometry = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_client_cert = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_client_cert_key = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_data_namespace = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack quobyte-client[86480]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.driver_use_ssl = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.extra_capabilities = {} {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.filter_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.goodness_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iscsi_target_flags = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iscsi_write_cache = on {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iser_helper = tgtadm {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iser_port = 3260 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: INFO cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f ... Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 -c /etc/quobyte/client-cinder.cfg {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_host = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_login = admin {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_mount_options = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_private_key = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_share_path = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.num_shell_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.quobyte_volume_url = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.replication_device = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.report_discard_supported = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.reserved_percentage = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_helper = tgtadm {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_port = 3260 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_protocol = iscsi {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.trace_flags = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.unique_fqdn_network = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.use_chap_auth = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_backend_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_clear = zero {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_clear_ionice = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_clear_size = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_reports.file_event_handler = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_reports.log_dir = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.backend_availability_zone = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.backend_host = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.chap_password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.chap_username = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.chiscsi_conf = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.disk_geometry = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_client_cert = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_data_namespace = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.driver_use_ssl = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.extra_capabilities = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.filter_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.goodness_function = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iser_helper = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iser_ip_address = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iser_port = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.iser_target_prefix = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_host = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_login = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_mount_options = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_password = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_private_key = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_share_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_ssh_port = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.num_shell_tries = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.nvmet_port_id = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.replication_device = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.report_discard_supported = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.reserved_percentage = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 -c /etc/quobyte/client-cinder.cfg Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.scst_target_driver = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.storage_protocol = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_helper = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_ip_address = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_port = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_prefix = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_protocol = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.trace_flags = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.use_chap_auth = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_clear = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_clear_size = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] QuobyteHD.volumes_dir = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_notifications.driver = [] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_notifications.retry = -1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] key_manager.fixed_key = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.barbican_api_version = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.barbican_endpoint = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.barbican_endpoint_type = public {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.barbican_region_name = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.cafile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.collect_timing = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.number_of_retries = 60 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.retry_delay = 1 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.send_service_user_token = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.split_loggers = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.verify_ssl = True {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican.verify_ssl_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.auth_section = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.auth_type = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.cafile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.certfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.collect_timing = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.insecure = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.keyfile = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.split_loggers = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] barbican_service_user.timeout = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.approle_role_id = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.approle_secret_id = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.kv_mountpoint = secret {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.kv_path = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.kv_version = 2 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.namespace = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.root_token_id = **** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.ssl_ca_crt_file = None {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.timeout = 60.0 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.use_ssl = False {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:47 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] ******************************************************************************** {{(pid=86260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:58:48 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:48 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.840s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:48 devstack cinder-volume[86479]: INFO cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f succeeded Jul 09 16:58:48 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:48 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.872s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:48 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:48 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:48 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:49 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.809s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:49 devstack cinder-volume[86479]: INFO cinder.volume.driver [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG cinder.volume.driver [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7536811828613, 'free_capacity_gb': 1775.7536811828613, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86479) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_db.sqlalchemy.engines [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86479) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG dbcounter [-] [86479] Writer thread running {{(pid=86479) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG cinder.db.api [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Building query based on filter {{(pid=86479) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG cinder.image.image_utils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86479) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:58:49 devstack cinder-volume[86479]: INFO cinder.keymgr.migration [None req-1f18ed96-f072-446e-8f5a-f60f0e446c8f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:49 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:49 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:49 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:50 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:50 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.081s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:50 devstack cinder-volume[86479]: DEBUG cinder.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Notifying Schedulers of capabilities ... {{(pid=86479) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:58:50 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Driver initialization completed successfully. Jul 09 16:58:50 devstack cinder-volume[86479]: INFO cinder.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Initiating service 3 cleanup Jul 09 16:58:50 devstack cinder-volume[86479]: INFO cinder.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Service 3 cleanup completed. Jul 09 16:58:50 devstack cinder-volume[86479]: DEBUG cinder.service [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Creating RPC server for service cinder-volume {{(pid=86479) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:58:50 devstack cinder-volume[86479]: DEBUG cinder.service [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86479) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:58:51 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:51 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:51 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:51 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:52 devstack cinder-volume[86260]: INFO oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Caught SIGTERM, stopping children Jul 09 16:58:52 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Acquiring lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:52 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Acquired lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:52 devstack cinder-volume[86260]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Releasing lock "singleton_lock" {{(pid=86260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:52 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Stop services. {{(pid=86260) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 16:58:52 devstack cinder-volume[86260]: DEBUG oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Killing children. {{(pid=86260) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 16:58:52 devstack cinder-volume[86260]: INFO oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Waiting on 1 children to exit Jul 09 16:58:52 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.177s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:52 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-91f22db2-7b99-4804-9669-ba2b0a84ebe3 None None] Driver post RPC initialization completed successfully. Jul 09 16:58:53 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Acquiring lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:53 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Acquired lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:53 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Releasing lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:53 devstack cinder-volume[86479]: WARNING amqp [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:58:53 devstack cinder-volume[86479]: WARNING amqp [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:58:53 devstack cinder-volume[86260]: INFO oslo_service.backend._eventlet.service [None req-b59672c5-d62f-4a99-b3cc-3223e95d7925 None None] Child 86479 exited with status 0 Jul 09 16:58:53 devstack cinder-volume[86789]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:58:53 devstack cinder-volume[86789]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:58:53 devstack cinder-volume[86789]: we strongly recommend against using it for new projects. Jul 09 16:58:53 devstack cinder-volume[86789]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:58:53 devstack cinder-volume[86789]: framework. For more detail see Jul 09 16:58:53 devstack cinder-volume[86789]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:58:53 devstack cinder-volume[86789]: import eventlet # noqa Jul 09 16:58:55 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:58:55 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:58:55 devstack cinder-volume[86789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:58:56 devstack cinder-volume[86789]: INFO dbcounter [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Registered counter for database cinder Jul 09 16:58:56 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:56 devstack cinder-volume[86789]: DEBUG dbcounter [-] [86789] Writer thread running {{(pid=86789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:58:56 devstack cinder-volume[86789]: INFO cinder.rpc [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:58:56 devstack cinder-volume[86789]: INFO cinder.rpc [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:58:56 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:56 devstack cinder-volume[86789]: INFO cinder.volume.manager [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Determined volume DB was empty at startup. Jul 09 16:58:56 devstack cinder-volume[86789]: DEBUG cinder.volume.manager [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86789) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:58:57 devstack cinder-volume[86789]: WARNING stevedore.named [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:58:57 devstack cinder-volume[86789]: WARNING castellan.key_manager [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:58:57 devstack cinder-volume[86789]: WARNING cinder.keymgr.conf_key_mgr [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:58:57 devstack cinder-volume[86789]: INFO cinder.volume.manager [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:57 devstack cinder-volume[86789]: INFO oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Starting 1 workers Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Started child 86876 {{(pid=86789) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Full set of CONF: {{(pid=86789) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] ******************************************************************************** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] Configuration options gathered from: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] ================================================================================ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] allow_availability_zone_fallback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86876]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] allow_compression_on_image_upload = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] allowed_direct_url_schemes = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] api_rate_limit = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] auth_strategy = keystone {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_host = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_stats_polling_interval = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backup_api_class = cinder.backup.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backup_name_template = backup-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backup_use_same_host = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backup_use_temp_snapshot = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] chap_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] chap_username = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_internal_tenant_project_id = 0962d8731bf148a4b9b5d41af8209617 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_internal_tenant_user_id = 7a7ae2a79c0e4489a2f90a7e990f8115 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cluster = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] compression_format = gzip {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] compute_api_class = cinder.compute.nova.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] config_dir = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] config_source = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] control_exchange = openstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] debug = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] default_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] default_group_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] default_volume_type = QuobyteHD {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] disk_geometry = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_client_cert = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_client_cert_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_data_namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_ssl_cert_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_ssl_cert_verify = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] driver_use_ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] enable_new_services = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] enable_unsupported_driver = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] enabled_backends = ['QuobyteHD'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] enforce_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] filter_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_api_insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_api_servers = ['http://192.168.122.125/image'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_api_ssl_compression = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_ca_certificates_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_catalog_info = image:glance:publicURL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_num_retries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance_request_timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] goodness_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] graceful_shutdown_timeout = 5 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] group_api_class = cinder.group.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] host = devstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_compress_on_upload = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_conversion_address_space_limit = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_conversion_cpu_limit = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_conversion_disable = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_upload_use_cinder_backend = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_upload_use_internal_tenant = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_volume_cache_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_volume_cache_max_count = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] image_volume_cache_max_size_gb = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] init_host_max_objects_retrieval = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] instance_format = [instance: %(uuid)s] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iscsi_target_flags = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iscsi_write_cache = on {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iser_helper = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iser_ip_address = 192.168.122.125 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iser_port = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_color = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_config_append = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_dir = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_options = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_rotate_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_rotate_interval_type = days {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] log_rotation_type = none {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86876) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] max_age = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] max_logfile_count = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] max_logfile_size_mb = 200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] max_over_subscription_ratio = 20.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] message_reap_interval = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] message_ttl = 2592000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] migration_create_volume_timeout_secs = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] monkey_patch = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] monkey_patch_modules = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] my_ip = 192.168.122.125 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] no_snapshot_gb_quota = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] num_iser_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] num_shell_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] num_volume_device_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] nvmeof_conn_info_version = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] nvmet_ns_id = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] nvmet_port_id = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_max_limit = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_ext_list = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_listen_port = 8776 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_use_ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] osapi_volume_workers = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] per_volume_size_limit = -1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] periodic_fuzzy_delay = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] periodic_interval = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] public_endpoint = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] publish_errors = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_backup_gigabytes = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_backups = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_gigabytes = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_groups = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_snapshots = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] quota_volumes = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] rate_limit_burst = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] rate_limit_except_level = CRITICAL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] rate_limit_interval = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] reinit_driver_count = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] replication_device = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] report_discard_supported = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] report_interval = 120 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] reservation_clean_interval = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] reservation_expire = 86400 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] reserved_image_namespaces = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] reserved_percentage = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] rpc_response_timeout = 120 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] run_external_periodic_tasks = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] scst_target_driver = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] scst_target_iqn_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_down_time = 720 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] shell_completion = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] snapshot_name_template = snapshot-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] state_path = /opt/stack/data/cinder {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] storage_availability_zone = nova {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] storage_protocol = iSCSI {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] syslog_log_facility = LOG_USER {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_helper = lioadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_ip_address = 192.168.122.125 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_port = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_protocol = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] target_secondary_ip_addresses = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] trace_flags = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] transport_url = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] until_refresh = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_chap_auth = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_default_quota_class = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_journal = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_json = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_stderr = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] use_syslog = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] verify_glance_signatures = enabled {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_api_class = cinder.volume.api.API {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_backend_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_clear = zero {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_clear_ionice = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_clear_size = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_copy_bps_limit = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_dd_blocksize = 1M {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_name_template = volume-%s {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_service_inithost_offload = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volume_usage_audit_period = month {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] zoning_mode = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_concurrency.disable_process_locking = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.auth_type = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.auth_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.cache = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.include_service_catalog = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.interface = public {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_password = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcache_username = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.region_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.service_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.125/identity {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.backend = dogpile.cache.null {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.backend_argument = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.backend_expiration_time = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.config_prefix = cache.oslo {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.debug_cache_backend = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.enable_retry_client = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.enable_socket_keepalive = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.expiration_time = 600 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.hashclient_retry_attempts = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_dead_retry = 300 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_pool_maxsize = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_sasl_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86876) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 16:58:57 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.proxies = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.redis_db = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.redis_server = localhost:6379 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.retry_attempts = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.retry_delay = 0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.socket_keepalive_count = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.socket_keepalive_idle = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.socket_keepalive_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.socket_timeout = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.tls_allowed_ciphers = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.tls_cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Running cmd (subprocess): mount.quobyte {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.tls_certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.tls_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.tls_keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cache.username = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] coordination.backend_url = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.asyncio_connection = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.asyncio_slave_connection = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.backend = sqlalchemy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.connection = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.connection_debug = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.connection_parameters = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.connection_recycle_time = 3600 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.connection_trace = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.db_inc_retry_interval = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.db_max_retries = 20 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.db_max_retry_interval = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.db_retry_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.max_overflow = 50 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.max_pool_size = 5 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.max_retries = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.mysql_wsrep_sync_wait = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.pool_timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.retry_interval = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.slave_connection = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.sqlite_synchronous = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.synchronous_reader = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] database.use_db_reconnect = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.connection_string = messaging:// {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.es_doc_type = notification {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.es_scroll_size = 10000 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.es_scroll_time = 2m {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.filter_error_trace = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.hmac_keys = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.sentinel_service_name = mymaster {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.socket_timeout = 0.1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.trace_requests = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler.trace_sqlalchemy = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler_jaeger.process_tags = {} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler_jaeger.service_name_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] profiler_otlp.service_name_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.enforce_new_defaults = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.enforce_scope = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.policy_default_rule = default {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.policy_file = policy.yaml {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.group = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.helper_command = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] privsep_osbrick.user = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.group = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.helper_command = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] cinder_sys_admin.user = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.auth_type = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.collect_timing = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.send_service_user_token = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] service_user.timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.auth_type = password {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.collect_timing = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.region_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] glance.timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.backend_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.chap_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.chap_username = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.disk_geometry = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_client_cert = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_client_cert_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_data_namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.driver_use_ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.extra_capabilities = {} {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.filter_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.goodness_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iscsi_target_flags = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iscsi_write_cache = on {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iser_helper = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iser_ip_address = 192.168.122.125 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iser_port = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_host = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_login = admin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_mount_options = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_private_key = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_share_path = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.num_shell_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.quobyte_volume_url = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.replication_device = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.report_discard_supported = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.reserved_percentage = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack quobyte-client[86877]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_helper = tgtadm {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_ip_address = 192.168.122.125 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack quobyte-client[86877]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_port = 3260 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_protocol = iscsi {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.trace_flags = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.unique_fqdn_network = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.use_chap_auth = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_backend_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_clear = zero {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_clear_ionice = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_clear_size = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_reports.file_event_handler = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_reports.log_dir = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.backend_availability_zone = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.backend_host = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.chap_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.chap_username = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.chiscsi_conf = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.disk_geometry = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_client_cert = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_data_namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.driver_use_ssl = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.extra_capabilities = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.filter_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.goodness_function = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iser_helper = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iser_ip_address = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iser_port = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.iser_target_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_host = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_login = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_mount_options = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_password = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_private_key = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_share_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_ssh_port = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.num_shell_tries = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.nvmet_port_id = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.replication_device = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.report_discard_supported = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.reserved_percentage = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.scst_target_driver = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.storage_protocol = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_helper = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_ip_address = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_port = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_prefix = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_protocol = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.trace_flags = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.use_chap_auth = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_clear = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_clear_size = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] QuobyteHD.volumes_dir = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_notifications.driver = [] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_notifications.retry = -1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] key_manager.fixed_key = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.barbican_api_version = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.barbican_endpoint = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.barbican_endpoint_type = public {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.barbican_region_name = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.collect_timing = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.number_of_retries = 60 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.retry_delay = 1 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.send_service_user_token = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.verify_ssl = True {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican.verify_ssl_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.auth_section = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.auth_type = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.cafile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.certfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.collect_timing = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.insecure = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.keyfile = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.split_loggers = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] barbican_service_user.timeout = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.approle_role_id = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.approle_secret_id = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.kv_mountpoint = secret {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.kv_path = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.kv_version = 2 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.namespace = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.root_token_id = **** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.ssl_ca_crt_file = None {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.timeout = 60.0 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.use_ssl = False {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:58:57 devstack cinder-volume[86789]: DEBUG oslo_service.backend._eventlet.service [None req-6e2b0652-dd5a-413e-baef-ac6078140731 None None] ******************************************************************************** {{(pid=86789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:58:57 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.640s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:57 devstack cinder-volume[86876]: INFO cinder.volume.driver [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:58:57 devstack cinder-volume[86876]: DEBUG cinder.volume.driver [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7536811828613, 'free_capacity_gb': 1775.7536811828613, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86876) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_db.sqlalchemy.engines [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writer thread running {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.db.api [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Building query based on filter {{(pid=86876) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86876) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:58 devstack cinder-volume[86876]: INFO cinder.keymgr.migration [None req-c721a557-d629-4bb7-a685-aea7f79e2d85 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:58:58 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:58 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:58 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.629s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:58:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Driver initialization completed successfully. Jul 09 16:58:58 devstack cinder-volume[86876]: INFO cinder.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Initiating service 3 cleanup Jul 09 16:58:58 devstack cinder-volume[86876]: INFO cinder.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Service 3 cleanup completed. Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.service [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Creating RPC server for service cinder-volume {{(pid=86876) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.service [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86876) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:58:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:58:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:58:58 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 16:58:58 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:58:59 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Jul 09 16:58:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.595s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:58:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-537bafe8-4f7b-433f-bcc4-76d9c09aa53a None None] Driver post RPC initialization completed successfully. Jul 09 16:59:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:59:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 6 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:59:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:59:07 devstack cinder-volume[86789]: DEBUG dbcounter [-] [86789] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:59:08 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:59:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:00:00 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:00:00 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:00:00 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.581s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:00:00 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:00:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:00:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 6 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:00:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:01:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:01:00 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:01:00 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:01:01 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Jul 09 17:01:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.073s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:01:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:01:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:01:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 6 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:01:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:01:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Flow 'volume_create_manager' (1910cf71-fae3-4182-88e8-9b02c369a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f706076-bf3f-4ae8-b9dd-59eb88369c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f706076-bf3f-4ae8-b9dd-59eb88369c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1775361716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4d1f01-3ce9-415d-94cb-8a1d67e5f92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32f3598b6de4335adea9a54b06f1a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:01:26Z,use_quota=True,user_id='5cf7285d962b4552990a9c223a333588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd41d35-b7e5-4bc4-a039-4f735954b9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd41d35-b7e5-4bc4-a039-4f735954b9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82e6bda-7589-4f4e-aafa-a9d65589c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82e6bda-7589-4f4e-aafa-a9d65589c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4d1f01-3ce9-415d-94cb-8a1d67e5f92f', 'volume_name': 'volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35bd48b-7c40-4540-810c-5c24afce8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35bd48b-7c40-4540-810c-5c24afce8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a54360-6c6e-48bd-88ee-5c472e1acf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Volume df4d1f01-3ce9-415d-94cb-8a1d67e5f92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f', 'volume_size': 1} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1775361716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4d1f01-3ce9-415d-94cb-8a1d67e5f92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32f3598b6de4335adea9a54b06f1a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:01:26Z,use_quota=True,user_id='5cf7285d962b4552990a9c223a333588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Creating volume df4d1f01-3ce9-415d-94cb-8a1d67e5f92f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:01:26 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:01:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:01:26 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f 1073741824 Jul 09 17:01:26 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:01:27 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Jul 09 17:01:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f 1073741824" returned: 0 in 1.397s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:01:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:01:28 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f Jul 09 17:01:28 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:01:28 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" returned: 0 in 0.890s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a54360-6c6e-48bd-88ee-5c472e1acf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7be1d4-c6d7-4e9a-888a-c2ba859d23f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:01:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Volume volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f (df4d1f01-3ce9-415d-94cb-8a1d67e5f92f): created successfully Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7be1d4-c6d7-4e9a-888a-c2ba859d23f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:01:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Flow 'volume_create_manager' (1910cf71-fae3-4182-88e8-9b02c369a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:01:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1e91e8a6-6c45-45dd-8cd5-d1b55f329122 tempest-TaggedAttachmentsTest-2047936824 None] Created volume successfully. Jul 09 17:01:38 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:01:38 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:00 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:02:00 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Flow 'volume_create_manager' (8609b8af-d12e-4a9b-a7a1-21836ef68173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6907fdae-1602-4de2-8201-6335445233ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6907fdae-1602-4de2-8201-6335445233ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-108710589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f27535-1de4-48ca-978c-31b5ab0d7e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf46f6dd90d14de999d40f35757130a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:02:01Z,use_quota=True,user_id='f47004fa4bc145d580c59cba52fdb08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ac5b00-515a-47d0-a998-3915fd883fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ac5b00-515a-47d0-a998-3915fd883fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e9c8d2-6342-47bf-a1c7-9f6acf83cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e9c8d2-6342-47bf-a1c7-9f6acf83cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f27535-1de4-48ca-978c-31b5ab0d7e49', 'volume_name': 'volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce4cbc3-160d-4430-854f-02047d976050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce4cbc3-160d-4430-854f-02047d976050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbff9bbd-6991-455a-bd80-430a2ef3e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:01 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Volume d8f27535-1de4-48ca-978c-31b5ab0d7e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49', 'volume_size': 1} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-108710589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f27535-1de4-48ca-978c-31b5ab0d7e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf46f6dd90d14de999d40f35757130a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:02:01Z,use_quota=True,user_id='f47004fa4bc145d580c59cba52fdb08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Creating volume d8f27535-1de4-48ca-978c-31b5ab0d7e49 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:02:01 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:02:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:01 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 1073741824 Jul 09 17:02:01 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:03 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 2.581s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 6 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Flow 'volume_create_manager' (07b3e7fb-998f-49d4-af26-b19f280eea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bafae75-3a90-4420-bd91-4bf3d08fc7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bafae75-3a90-4420-bd91-4bf3d08fc7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-900294406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967fdcdd-9ba0-405d-8989-4397aa57b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e6a498926e40c09f8c10c843c84c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:02:03Z,use_quota=True,user_id='f4e0e9588b1d4cd399020f4dec1e9553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed53c1a2-7c09-4dbe-abd7-9264ad07ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed53c1a2-7c09-4dbe-abd7-9264ad07ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16073c11-9dc3-4063-b428-9e2e2f127d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16073c11-9dc3-4063-b428-9e2e2f127d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967fdcdd-9ba0-405d-8989-4397aa57b535', 'volume_name': 'volume-967fdcdd-9ba0-405d-8989-4397aa57b535', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65eb1890-676c-4e9a-8719-7c0582b5ef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65eb1890-676c-4e9a-8719-7c0582b5ef2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2b1a0-4056-4bdc-8ddc-3997ea8f45e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Volume 967fdcdd-9ba0-405d-8989-4397aa57b535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967fdcdd-9ba0-405d-8989-4397aa57b535', 'volume_size': 1} Jul 09 17:02:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:04 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 1073741824" returned: 0 in 2.445s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:04 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 Jul 09 17:02:04 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:05 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49" returned: 0 in 1.180s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] <== create_volume: return (3744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.747s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-900294406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967fdcdd-9ba0-405d-8989-4397aa57b535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e6a498926e40c09f8c10c843c84c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:02:03Z,use_quota=True,user_id='f4e0e9588b1d4cd399020f4dec1e9553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Creating volume 967fdcdd-9ba0-405d-8989-4397aa57b535 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:02:05 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:05 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 1073741824 Jul 09 17:02:05 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbff9bbd-6991-455a-bd80-430a2ef3e69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c134266-3513-44be-ba85-5d0e2edbda03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:05 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Volume volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 (d8f27535-1de4-48ca-978c-31b5ab0d7e49): created successfully Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c134266-3513-44be-ba85-5d0e2edbda03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Flow 'volume_create_manager' (8609b8af-d12e-4a9b-a7a1-21836ef68173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:02:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7cbdf544-9299-404f-90dc-ca36b9b594d7 tempest-DeleteServersTestJSON-664232511 None] Created volume successfully. Jul 09 17:02:07 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 1073741824" returned: 0 in 1.863s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:07 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 Jul 09 17:02:07 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:09 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535" returned: 0 in 1.831s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] <== create_volume: return (3765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.773s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2b1a0-4056-4bdc-8ddc-3997ea8f45e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967fdcdd-9ba0-405d-8989-4397aa57b535', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9098be3-7d92-4878-9a08-222700eefbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:02:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Volume volume-967fdcdd-9ba0-405d-8989-4397aa57b535 (967fdcdd-9ba0-405d-8989-4397aa57b535): created successfully Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9098be3-7d92-4878-9a08-222700eefbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:02:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Flow 'volume_create_manager' (07b3e7fb-998f-49d4-af26-b19f280eea90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:02:09 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0dea9095-e7bb-4bb0-952d-87bcfab78add tempest-VolumesAdminNegativeTest-465805886 None] Created volume successfully. Jul 09 17:02:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Acquiring lock "cinder-967fdcdd-9ba0-405d-8989-4397aa57b535-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:02:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "cinder-967fdcdd-9ba0-405d-8989-4397aa57b535-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:02:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Acquiring lock "cinder-quobyte-967fdcdd-9ba0-405d-8989-4397aa57b535" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:02:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "cinder-quobyte-967fdcdd-9ba0-405d-8989-4397aa57b535" acquired by "delete_volume" :: waited 0.047s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:02:11 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo2594nso/privsep.sock'] Jul 09 17:02:11 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo2594nso/privsep.sock Jul 09 17:02:11 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 17:02:12 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 17:02:14 devstack cinder-volume[86876]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 17:02:15 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:15 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Spawned new privsep daemon via rootwrap Jul 09 17:02:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Accepted privsep connection to /tmp/tmpo2594nso/privsep.sock {{(pid=86876) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 17:02:15 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 17:02:15 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 17:02:15 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 17:02:15 devstack cinder-volume[86876]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88397 Jul 09 17:02:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[758935f2-b602-45f2-9bda-0bda498e2b79]: (2,) {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b983c2f-ecee-4a7a-8405-46b7d341e25f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:16 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 Jul 09 17:02:16 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:16 devstack cinder-volume[86876]: WARNING py.warnings [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 09 17:02:16 devstack cinder-volume[86876]: .first() Jul 09 17:02:16 devstack cinder-volume[86876]: Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a3ad0-ef48-4058-9951-e94a5292572c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:02:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:17 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 Jul 09 17:02:17 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:18 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535" returned: 0 in 2.325s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:18 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535 Jul 09 17:02:18 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:19 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49" returned: 0 in 2.863s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.915s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ff0ac3c-b7e2-4d60-937b-630cece82f00', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:02:19 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967fdcdd-9ba0-405d-8989-4397aa57b535" returned: 0 in 1.553s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "cinder-quobyte-967fdcdd-9ba0-405d-8989-4397aa57b535" released by "delete_volume" :: held 8.773s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:02:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-c17eb446-8a71-493d-a38c-a2bee3cbc6f9 req-bec39ee1-537a-407d-b0b2-290483f896f1 tempest-DeleteServersTestJSON-664232511 None] attachment_update completed successfully. Jul 09 17:02:20 devstack cinder-volume[86876]: WARNING cinder.quota [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:02:20 devstack cinder-volume[86876]: WARNING cinder.quota [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Created reservations ['ee51e9b4-5710-4a75-b8d6-c445e52f91b5', '999678f3-83d8-4d1f-b870-ff4df51a242f', 'a75ef9be-cc17-4cc6-95d9-a03d5fd1b1df', '6613c5b1-9202-472c-bb7c-e2f69ad61368'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:20 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:02:20 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:22 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 2.026s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:22 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:02:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Deleted volume successfully. Jul 09 17:02:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1b279e81-0874-43d4-a74b-231f26c59549 tempest-VolumesAdminNegativeTest-465805886 None] Lock "cinder-967fdcdd-9ba0-405d-8989-4397aa57b535-delete_volume" released by "delete_volume" :: held 11.745s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:02:30 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:02:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-7f04f7e8-81d3-437c-b6fd-44b7c05d4df2 req-69f25d85-8e64-48f7-80d5-e5f2a229d82a tempest-DeleteServersTestJSON-664232511 None] Terminate volume connection completed successfully. Jul 09 17:02:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-7f04f7e8-81d3-437c-b6fd-44b7c05d4df2 req-69f25d85-8e64-48f7-80d5-e5f2a229d82a tempest-DeleteServersTestJSON-664232511 None] Deleting attachment 1ff0ac3c-b7e2-4d60-937b-630cece82f00. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:02:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "cinder-d8f27535-1de4-48ca-978c-31b5ab0d7e49-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "cinder-d8f27535-1de4-48ca-978c-31b5ab0d7e49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "cinder-quobyte-d8f27535-1de4-48ca-978c-31b5ab0d7e49" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "cinder-quobyte-d8f27535-1de4-48ca-978c-31b5ab0d7e49" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d1c2d-4148-43ee-ae65-e908934bea4e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:37 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 Jul 09 17:02:37 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:37 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49" returned: 0 in 0.847s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:37 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49 Jul 09 17:02:37 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:38 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d8f27535-1de4-48ca-978c-31b5ab0d7e49" returned: 0 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "cinder-quobyte-d8f27535-1de4-48ca-978c-31b5ab0d7e49" released by "delete_volume" :: held 1.660s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Created reservations ['1b53c6b6-676f-4f27-806b-238a29e49ee8', '41e710d9-dcce-4fcc-b64c-a53abbe94ff2', 'c2f401f6-8b9f-40a0-a8e7-f8b9a41d1ecb', 'c6386b91-1662-4fda-92de-4f90d56c3546'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:02:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:02:38 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:02:38 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:02:39 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Jul 09 17:02:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:02:39 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:02:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Deleted volume successfully. Jul 09 17:02:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6a7d028c-c9a9-4f23-a52d-eba53abe2b23 tempest-DeleteServersTestJSON-664232511 None] Lock "cinder-d8f27535-1de4-48ca-978c-31b5ab0d7e49-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:02:48 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:02:49 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=25,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:00 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:03:00 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:01 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (919b2df2-b9ee-451c-b372-257013ad87bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddb8574-af52-4a28-ad71-a9146658026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddb8574-af52-4a28-ad71-a9146658026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1022383192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5561ac3-c8c4-43d2-bec7-747ab63a5f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:07Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d193a-cda1-451d-a51e-109856e3bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d193a-cda1-451d-a51e-109856e3bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b4c3df-e772-4630-a09c-1d9d338d150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b4c3df-e772-4630-a09c-1d9d338d150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5561ac3-c8c4-43d2-bec7-747ab63a5f61', 'volume_name': 'volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd684021-948b-48e6-ba15-18c4ed07d041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd684021-948b-48e6-ba15-18c4ed07d041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1b1794-1492-4775-b946-cbd392d1911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:07 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Volume d5561ac3-c8c4-43d2-bec7-747ab63a5f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61', 'volume_size': 1} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1022383192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5561ac3-c8c4-43d2-bec7-747ab63a5f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:07Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Creating volume d5561ac3-c8c4-43d2-bec7-747ab63a5f61 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:03:07 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:03:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:07 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 1073741824 Jul 09 17:03:07 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:08 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 1073741824" returned: 0 in 0.930s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:08 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 Jul 09 17:03:08 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:09 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" returned: 0 in 1.157s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.767s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1b1794-1492-4775-b946-cbd392d1911b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce5ebd-67b7-42a5-bb52-e9542fe0c649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a379f6ae-b644-4cdf-92ea-5c72e78f0410]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Volume volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 (d5561ac3-c8c4-43d2-bec7-747ab63a5f61): created successfully Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce5ebd-67b7-42a5-bb52-e9542fe0c649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (919b2df2-b9ee-451c-b372-257013ad87bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:09 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d1f26e8d-3c0b-4d4a-a6b3-ec03a6cc4d1f tempest-AttachVolumeNegativeTest-1647098669 None] Created volume successfully. Jul 09 17:03:09 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f Jul 09 17:03:09 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:10 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" returned: 0 in 1.183s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.251s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e589df11-b84f-4874-b261-932fb1f85733', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:03:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-4857fe0b-4665-45a4-b0db-6bca832e848b req-4ae1036d-7a62-4bbc-a061-8b126e1fc4f5 tempest-TaggedAttachmentsTest-2047936824 None] attachment_update completed successfully. Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c183d5-6d87-4bf4-827b-a33b4aa09b5f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:14 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 Jul 09 17:03:14 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:14 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" returned: 0 in 0.800s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd677cd69-d7d7-4b0c-bd0f-782dea27068c', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:03:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-b98f1a92-10bf-4b95-b733-df1707505df5 req-6bc4fa81-a291-4526-b78e-c5a8a40280e6 tempest-AttachVolumeNegativeTest-1647098669 None] attachment_update completed successfully. Jul 09 17:03:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-5d40c982-f893-4e9f-9b4c-0dc8f4c6e59e req-dda1cdda-f0ac-41bf-8f21-2eaa23e6b332 tempest-TaggedAttachmentsTest-2047936824 None] Terminate volume connection completed successfully. Jul 09 17:03:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-5d40c982-f893-4e9f-9b4c-0dc8f4c6e59e req-dda1cdda-f0ac-41bf-8f21-2eaa23e6b332 tempest-TaggedAttachmentsTest-2047936824 None] Deleting attachment e589df11-b84f-4874-b261-932fb1f85733. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:03:25 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=6,cinder:SELECT=15,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:03:30 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "cinder-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "cinder-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "cinder-quobyte-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "cinder-quobyte-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fb9a43-6fe1-46d8-895f-89de5223312b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:03:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:47 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f Jul 09 17:03:47 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:47 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" returned: 0 in 0.968s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:47 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f Jul 09 17:03:47 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:48 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" returned: 0 in 0.705s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "cinder-quobyte-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f" released by "delete_volume" :: held 1.733s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Created reservations ['d4452bb6-9133-4558-8b8c-d7890b91a7de', 'a8e27adf-53cd-462e-bf93-0e74231387eb', 'a352a353-8c40-41f2-a443-4c693c64dfd5', 'e62025ad-77ec-4844-9f20-4dbbf1f27326'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:48 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:03:48 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:49 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.094s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:49 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:03:49 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Deleted volume successfully. Jul 09 17:03:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2941933-a12c-4390-8017-2de1a58e168e tempest-TaggedAttachmentsTest-2047936824 None] Lock "cinder-df4d1f01-3ce9-415d-94cb-8a1d67e5f92f-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:03:49 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Flow 'volume_create_manager' (e3f44663-ff2e-4d5c-892c-b53309f8a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b4475-172d-4e87-886b-3becfd240035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b4475-172d-4e87-886b-3becfd240035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-284504839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a61ae0-f55e-4773-a5ae-846323ee94fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da097c929840cc884044f0f83e82ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:50Z,use_quota=True,user_id='87387bc3dd1744fdbf0201a11d6a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd98a107-2b3a-45dd-98bc-9547d756450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd98a107-2b3a-45dd-98bc-9547d756450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5e045a-e59b-42ff-b3a6-22003bc517b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5e045a-e59b-42ff-b3a6-22003bc517b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a61ae0-f55e-4773-a5ae-846323ee94fb', 'volume_name': 'volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44435c47-f21d-4e78-bad5-9ecc1e0e7c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44435c47-f21d-4e78-bad5-9ecc1e0e7c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01422fe-70af-4480-a31b-0e3af952e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Volume f5a61ae0-f55e-4773-a5ae-846323ee94fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb', 'volume_size': 1} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-284504839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a61ae0-f55e-4773-a5ae-846323ee94fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da097c929840cc884044f0f83e82ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:50Z,use_quota=True,user_id='87387bc3dd1744fdbf0201a11d6a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Creating volume f5a61ae0-f55e-4773-a5ae-846323ee94fb {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:03:50 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:03:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:50 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb 1073741824 Jul 09 17:03:50 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:51 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb 1073741824" returned: 0 in 1.208s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:51 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb Jul 09 17:03:51 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Flow 'volume_create_manager' (d0792ee8-0dea-47e7-84cf-4716531a1996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84e043-4cc9-4b04-8bef-a4e9545da98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84e043-4cc9-4b04-8bef-a4e9545da98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-548969034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df994c0-1df1-400e-ad45-1f3cb408ccdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d6a59b341e4dc28a0d946c385c3bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:51Z,use_quota=True,user_id='e0ada65695144619b124b03a1c0eb091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041af3e4-3e0c-4750-810e-08a58c27d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041af3e4-3e0c-4750-810e-08a58c27d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c414352-7cae-4b73-a25e-558c94266b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c414352-7cae-4b73-a25e-558c94266b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df994c0-1df1-400e-ad45-1f3cb408ccdf', 'volume_name': 'volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596afe74-eb06-4326-8d17-865273473294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596afe74-eb06-4326-8d17-865273473294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d4b84e-d687-4ed4-b7ea-57ae0956d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:51 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Volume 1df994c0-1df1-400e-ad45-1f3cb408ccdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf', 'volume_size': 1} Jul 09 17:03:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:52 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb" returned: 0 in 0.737s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-548969034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df994c0-1df1-400e-ad45-1f3cb408ccdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d6a59b341e4dc28a0d946c385c3bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:51Z,use_quota=True,user_id='e0ada65695144619b124b03a1c0eb091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Creating volume 1df994c0-1df1-400e-ad45-1f3cb408ccdf {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:03:52 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01422fe-70af-4480-a31b-0e3af952e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71d8e06-6a8b-43b2-9264-aca530fad343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:52 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf 1073741824 Jul 09 17:03:52 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:52 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Volume volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb (f5a61ae0-f55e-4773-a5ae-846323ee94fb): created successfully Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71d8e06-6a8b-43b2-9264-aca530fad343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Flow 'volume_create_manager' (e3f44663-ff2e-4d5c-892c-b53309f8a491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:52 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0448a8d6-7bcd-41e2-94b6-fa0b06839981 tempest-AttachVolumeShelveTestJSON-1104423269 None] Created volume successfully. Jul 09 17:03:53 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf 1073741824" returned: 0 in 1.105s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:53 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf Jul 09 17:03:53 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:54 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf" returned: 0 in 0.973s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d4b84e-d687-4ed4-b7ea-57ae0956d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7365967-bfe2-4d88-9287-a99322c8fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:54 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Volume volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf (1df994c0-1df1-400e-ad45-1f3cb408ccdf): created successfully Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7365967-bfe2-4d88-9287-a99322c8fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Flow 'volume_create_manager' (d0792ee8-0dea-47e7-84cf-4716531a1996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a01d13b3-d5ae-4ffe-83b9-1b44ac2a5c72 tempest-ServersNegativeTestJSON-30900086 None] Created volume successfully. Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Flow 'volume_create_manager' (2372af58-3d4b-470d-b0ff-436f1e88fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe16e00-5e09-4fc8-ad1f-0afdf71997de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe16e00-5e09-4fc8-ad1f-0afdf71997de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471913933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cd76ca-e933-4a51-a02a-70ecb74b02c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d6a59b341e4dc28a0d946c385c3bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:56Z,use_quota=True,user_id='e0ada65695144619b124b03a1c0eb091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97cdb20-ec5b-44c6-9b18-953d9a7f355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97cdb20-ec5b-44c6-9b18-953d9a7f355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b46bc0b-d0ad-4939-8ff4-b3569e99fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b46bc0b-d0ad-4939-8ff4-b3569e99fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35cd76ca-e933-4a51-a02a-70ecb74b02c1', 'volume_name': 'volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3bf05e-f1b3-47a2-8f89-c23a90b30503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3bf05e-f1b3-47a2-8f89-c23a90b30503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581d2dfa-3fee-443a-9f0b-01b22ea0464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Volume 35cd76ca-e933-4a51-a02a-70ecb74b02c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1', 'volume_size': 1} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471913933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cd76ca-e933-4a51-a02a-70ecb74b02c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d6a59b341e4dc28a0d946c385c3bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:03:56Z,use_quota=True,user_id='e0ada65695144619b124b03a1c0eb091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Creating volume 35cd76ca-e933-4a51-a02a-70ecb74b02c1 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:03:56 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:03:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:56 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 1073741824 Jul 09 17:03:56 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:57 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 1073741824" returned: 0 in 1.042s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:57 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 Jul 09 17:03:57 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:57 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1" returned: 0 in 0.780s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581d2dfa-3fee-443a-9f0b-01b22ea0464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7d960-aa25-41a6-a386-829212b69e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:03:57 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Volume volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 (35cd76ca-e933-4a51-a02a-70ecb74b02c1): created successfully Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7d960-aa25-41a6-a386-829212b69e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Flow 'volume_create_manager' (2372af58-3d4b-470d-b0ff-436f1e88fae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:03:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1005d1a8-f675-42f9-939a-eb2da60c8209 tempest-ServersNegativeTestJSON-30900086 None] Created volume successfully. Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "cinder-35cd76ca-e933-4a51-a02a-70ecb74b02c1-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-35cd76ca-e933-4a51-a02a-70ecb74b02c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "cinder-quobyte-35cd76ca-e933-4a51-a02a-70ecb74b02c1" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-quobyte-35cd76ca-e933-4a51-a02a-70ecb74b02c1" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae38e86-ce95-4faf-a0cb-71cfc021b827]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:03:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:58 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 Jul 09 17:03:58 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:03:59 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Jul 09 17:03:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1" returned: 0 in 0.944s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:03:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:03:59 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1 Jul 09 17:03:59 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:04:00 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-35cd76ca-e933-4a51-a02a-70ecb74b02c1" returned: 0 in 0.980s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-quobyte-35cd76ca-e933-4a51-a02a-70ecb74b02c1" released by "delete_volume" :: held 1.974s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Created reservations ['c28e3cba-a4c2-4059-9462-fb2b6e8f9fdf', '63e4ce2f-61ab-49ae-9595-32c119289ae7', 'f48d3224-a29c-41a0-9bb1-2f1611c35600', '5b78b548-5c6d-4a9b-b598-4e551e851a78'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:00 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:00 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "cinder-1df994c0-1df1-400e-ad45-1f3cb408ccdf-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-1df994c0-1df1-400e-ad45-1f3cb408ccdf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "cinder-quobyte-1df994c0-1df1-400e-ad45-1f3cb408ccdf" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-quobyte-1df994c0-1df1-400e-ad45-1f3cb408ccdf" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8255ebd-10ab-4298-b2d1-5b377341f67f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:01 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf Jul 09 17:04:01 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:01 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Deleted volume successfully. Jul 09 17:04:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70c8b1fb-d885-4d2c-bae6-fc3941776777 tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-35cd76ca-e933-4a51-a02a-70ecb74b02c1-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:02 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf" returned: 0 in 1.256s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:02 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf Jul 09 17:04:02 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:03 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1df994c0-1df1-400e-ad45-1f3cb408ccdf" returned: 0 in 0.892s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-quobyte-1df994c0-1df1-400e-ad45-1f3cb408ccdf" released by "delete_volume" :: held 2.215s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Created reservations ['9789f5b2-24da-4019-ac88-c1e6f2097626', '34ac16b0-70f4-4354-9074-64ce26f3b900', '45d5a8ec-4d97-4334-be20-8830fbca9aa6', '2bf15f82-cdf8-49a1-9fb1-9a64661946e2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:03 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:03 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:04 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.746s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:04 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:04 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Deleted volume successfully. Jul 09 17:04:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c2c9b9be-f948-4446-8179-41e34c57bb2b tempest-ServersNegativeTestJSON-30900086 None] Lock "cinder-1df994c0-1df1-400e-ad45-1f3cb408ccdf-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:13 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=32,cinder:SELECT=17,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:04:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-5daa2ca7-b29e-405b-80cd-ba4e76b4f652 req-b9e6de94-9cd4-4ba1-9248-71efbb81cd7b tempest-AttachVolumeShelveTestJSON-1104423269 None] No connector for attachment 1acf8ceb-7ade-4ebb-a5e8-c78fb8a36f19; skipping storage backend terminate_connection call. {{(pid=86876) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 17:04:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-5daa2ca7-b29e-405b-80cd-ba4e76b4f652 req-b9e6de94-9cd4-4ba1-9248-71efbb81cd7b tempest-AttachVolumeShelveTestJSON-1104423269 None] Deleting attachment 1acf8ceb-7ade-4ebb-a5e8-c78fb8a36f19. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:04:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-900e3fcb-48b9-4c6d-b64a-c7bf992dda92 req-9bb8a3f8-c7c5-43e5-b3d3-e61a923cf110 tempest-AttachVolumeNegativeTest-1647098669 None] Terminate volume connection completed successfully. Jul 09 17:04:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-900e3fcb-48b9-4c6d-b64a-c7bf992dda92 req-9bb8a3f8-c7c5-43e5-b3d3-e61a923cf110 tempest-AttachVolumeNegativeTest-1647098669 None] Deleting attachment d677cd69-d7d7-4b0c-bd0f-782dea27068c. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Flow 'volume_create_manager' (f3e2c350-2570-4e76-b0cb-6271f58f1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f2e8b-ac33-4656-8655-97b77d5d0c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f2e8b-ac33-4656-8655-97b77d5d0c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-957189090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed005cb-cbdc-4b6e-b341-929d6ef783d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c38119d6867648c08f2342de689f0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:22Z,use_quota=True,user_id='c3b21f04414b4339a0c7aebaa28ebc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957d1e01-cf47-4088-b7ed-cef9abdaa840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957d1e01-cf47-4088-b7ed-cef9abdaa840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf76ef82-261a-4d4b-9c37-a204879592e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf76ef82-261a-4d4b-9c37-a204879592e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed005cb-cbdc-4b6e-b341-929d6ef783d5', 'volume_name': 'volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca5215e-9da0-4624-979d-6d9444062f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca5215e-9da0-4624-979d-6d9444062f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621a6cfb-d724-412f-8d2a-f602925753e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:22 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Volume 9ed005cb-cbdc-4b6e-b341-929d6ef783d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5', 'volume_size': 1} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-957189090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed005cb-cbdc-4b6e-b341-929d6ef783d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c38119d6867648c08f2342de689f0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:22Z,use_quota=True,user_id='c3b21f04414b4339a0c7aebaa28ebc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Creating volume 9ed005cb-cbdc-4b6e-b341-929d6ef783d5 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:04:22 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:04:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:22 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 1073741824 Jul 09 17:04:22 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:23 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 1073741824" returned: 0 in 0.890s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:23 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 Jul 09 17:04:23 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:24 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" returned: 0 in 0.938s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621a6cfb-d724-412f-8d2a-f602925753e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4d8ab-fe0a-45f2-be7b-d40bf99f5944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Volume volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 (9ed005cb-cbdc-4b6e-b341-929d6ef783d5): created successfully Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4d8ab-fe0a-45f2-be7b-d40bf99f5944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Flow 'volume_create_manager' (f3e2c350-2570-4e76-b0cb-6271f58f1881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-269ff099-d630-48bb-a6f3-0f4738ca8ae3 req-d2882b50-7211-43ec-afa2-512b028f273f tempest-VolumesGetTestJSON-350411135 None] Created volume successfully. Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Acquiring lock "cinder-9ed005cb-cbdc-4b6e-b341-929d6ef783d5-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "cinder-9ed005cb-cbdc-4b6e-b341-929d6ef783d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Acquiring lock "cinder-quobyte-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "cinder-quobyte-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8389be-1139-4b55-b1b3-f5d122910266]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:04:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:24 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 Jul 09 17:04:24 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:25 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" returned: 0 in 1.266s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:25 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5 Jul 09 17:04:25 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:27 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" returned: 0 in 1.168s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "cinder-quobyte-9ed005cb-cbdc-4b6e-b341-929d6ef783d5" released by "delete_volume" :: held 2.501s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG cinder.quota [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Created reservations ['c41e49ec-666d-47a3-a517-2c6ee56a1213', '274ea6ee-9f93-4098-a73d-d7d8c43c4501', '38418113-5688-4ba9-9073-3f75c940030b', '28910a1d-f8da-42e2-bb67-c7eb8c740b44'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:27 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:27 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:28 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:28 devstack cinder-volume[86876]: DEBUG cinder.manager [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Deleted volume successfully. Jul 09 17:04:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-da21752a-3060-4a10-9fa1-5a779c1bc1c9 req-fcf8292f-8dfe-4f55-b14e-e801c4b383f5 tempest-VolumesGetTestJSON-350411135 None] Lock "cinder-9ed005cb-cbdc-4b6e-b341-929d6ef783d5-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (38ce092e-f0c2-4228-9a4e-9d2ab82b3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d697b5-9d03-4a4a-9cec-c3687b6ad786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d697b5-9d03-4a4a-9cec-c3687b6ad786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-177674933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81de6a5b-58ef-491c-8506-848382d7b9e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:34Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f00ace-0b54-4f95-bbe9-829b03faf066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f00ace-0b54-4f95-bbe9-829b03faf066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e150c3-e0ec-4dc0-95aa-0740c7adbf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e150c3-e0ec-4dc0-95aa-0740c7adbf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81de6a5b-58ef-491c-8506-848382d7b9e4', 'volume_name': 'volume-81de6a5b-58ef-491c-8506-848382d7b9e4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0945ce2a-b141-4303-b5e9-06fdf1b2bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0945ce2a-b141-4303-b5e9-06fdf1b2bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b4fd6-330c-4c98-ad40-a14e48725266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Volume 81de6a5b-58ef-491c-8506-848382d7b9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81de6a5b-58ef-491c-8506-848382d7b9e4', 'volume_size': 1} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-177674933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81de6a5b-58ef-491c-8506-848382d7b9e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:34Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Creating volume 81de6a5b-58ef-491c-8506-848382d7b9e4 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:04:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:04:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:33 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 1073741824 Jul 09 17:04:33 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:35 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 1073741824" returned: 0 in 1.423s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:35 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 Jul 09 17:04:35 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:36 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4" returned: 0 in 1.344s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] <== create_volume: return (2867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.875s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b4fd6-330c-4c98-ad40-a14e48725266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81de6a5b-58ef-491c-8506-848382d7b9e4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbb8988-d247-4a46-85e9-2bbd524cdb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:36 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Volume volume-81de6a5b-58ef-491c-8506-848382d7b9e4 (81de6a5b-58ef-491c-8506-848382d7b9e4): created successfully Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbb8988-d247-4a46-85e9-2bbd524cdb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (38ce092e-f0c2-4228-9a4e-9d2ab82b3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a4a968e9-a590-43c6-a95d-b25e324b4aea tempest-VolumesTestJSON-1768515832 None] Created volume successfully. Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (d64744b2-6e74-4ae8-90b6-b113138f4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeebddc-7053-4c2a-b4bb-8bae60e8f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeebddc-7053-4c2a-b4bb-8bae60e8f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-649013236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c059f575-bdfa-4cd2-bc10-3416b5aca6a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:38Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c4afac-becd-4961-b134-b2d437d85fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c4afac-becd-4961-b134-b2d437d85fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf18f80e-d42a-481c-ae40-06072d2b7d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf18f80e-d42a-481c-ae40-06072d2b7d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c059f575-bdfa-4cd2-bc10-3416b5aca6a5', 'volume_name': 'volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2942fa3-fda5-4595-a248-ed066173dec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2942fa3-fda5-4595-a248-ed066173dec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629201ad-83d2-4170-848e-754a8da8655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:38 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Volume c059f575-bdfa-4cd2-bc10-3416b5aca6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5', 'volume_size': 1} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-649013236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c059f575-bdfa-4cd2-bc10-3416b5aca6a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:38Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Creating volume c059f575-bdfa-4cd2-bc10-3416b5aca6a5 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:04:38 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:04:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:38 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 1073741824 Jul 09 17:04:38 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:39 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 1073741824" returned: 0 in 1.314s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:39 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 Jul 09 17:04:39 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:40 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629201ad-83d2-4170-848e-754a8da8655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89558f90-dcd2-4893-98ed-e4942d8d7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Volume volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 (c059f575-bdfa-4cd2-bc10-3416b5aca6a5): created successfully Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89558f90-dcd2-4893-98ed-e4942d8d7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (d64744b2-6e74-4ae8-90b6-b113138f4b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8321c8b1-1041-4d17-81cb-f3151ad6a912 tempest-VolumesTestJSON-1768515832 None] Created volume successfully. Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (0b28e085-1e9f-486e-99c4-9e21cc0d015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05003c78-1d1a-4e4f-b953-56d089fb18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05003c78-1d1a-4e4f-b953-56d089fb18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150505702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bce9291-583d-46dc-8064-491b749d5c71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:42Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8893ee57-9e39-4263-b568-dcab7cf4b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8893ee57-9e39-4263-b568-dcab7cf4b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e935514a-8907-4ebc-8e11-731b63c59e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e935514a-8907-4ebc-8e11-731b63c59e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bce9291-583d-46dc-8064-491b749d5c71', 'volume_name': 'volume-3bce9291-583d-46dc-8064-491b749d5c71', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3826e-545d-485f-ab93-ff6d09294edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3826e-545d-485f-ab93-ff6d09294edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ae2fc-1b0a-4ec0-a741-56cf53028135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:42 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Volume 3bce9291-583d-46dc-8064-491b749d5c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bce9291-583d-46dc-8064-491b749d5c71', 'volume_size': 1} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150505702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bce9291-583d-46dc-8064-491b749d5c71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26e8d0a609744e859d45fb1b7669c3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:04:42Z,use_quota=True,user_id='5887c9e5a0db48ebb47626b1c86c21d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Creating volume 3bce9291-583d-46dc-8064-491b749d5c71 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:04:42 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:04:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:42 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 1073741824 Jul 09 17:04:42 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:43 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 1073741824" returned: 0 in 1.402s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:44 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 Jul 09 17:04:44 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:45 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71" returned: 0 in 1.254s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] <== create_volume: return (2750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.756s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=37,cinder:UPDATE=55,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ae2fc-1b0a-4ec0-a741-56cf53028135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bce9291-583d-46dc-8064-491b749d5c71', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20656629-d589-41fb-a62f-d5112fa5b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:04:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Volume volume-3bce9291-583d-46dc-8064-491b749d5c71 (3bce9291-583d-46dc-8064-491b749d5c71): created successfully Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20656629-d589-41fb-a62f-d5112fa5b480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:04:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Flow 'volume_create_manager' (0b28e085-1e9f-486e-99c4-9e21cc0d015e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:04:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-adfec2a2-aa5f-4677-91fc-5ab6e4a605fd tempest-VolumesTestJSON-1768515832 None] Created volume successfully. Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-3bce9291-583d-46dc-8064-491b749d5c71-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-3bce9291-583d-46dc-8064-491b749d5c71-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-quobyte-3bce9291-583d-46dc-8064-491b749d5c71" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-3bce9291-583d-46dc-8064-491b749d5c71" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535cda9-775b-40a7-9f6d-24c73e777a00]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:04:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:46 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 Jul 09 17:04:46 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:47 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71" returned: 0 in 0.914s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:47 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71 Jul 09 17:04:47 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:48 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3bce9291-583d-46dc-8064-491b749d5c71" returned: 0 in 0.708s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-3bce9291-583d-46dc-8064-491b749d5c71" released by "delete_volume" :: held 1.682s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Created reservations ['f0d009ce-6573-4a4f-9b52-639f0cfd0143', 'dceacf00-8fd7-44d1-b187-ca04a43d6068', 'dd8d01c5-9121-478a-902d-d4d451db8406', '8487f527-4154-4a6d-857d-952ceac5dbca'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:48 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:48 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-c059f575-bdfa-4cd2-bc10-3416b5aca6a5-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "cinder-c059f575-bdfa-4cd2-bc10-3416b5aca6a5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-quobyte-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d46ff-adc3-458a-8b39-0fb98b68685a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:04:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:49 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 Jul 09 17:04:49 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:50 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.443s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:50 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Deleted volume successfully. Jul 09 17:04:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3929cf1-d6da-4913-b241-86093eea5db9 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-3bce9291-583d-46dc-8064-491b749d5c71-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:50 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" returned: 0 in 1.224s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:50 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5 Jul 09 17:04:50 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:51 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" returned: 0 in 0.650s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-c059f575-bdfa-4cd2-bc10-3416b5aca6a5" released by "delete_volume" :: held 1.926s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Created reservations ['9fbba9b3-09a6-465d-9fd6-8cc93f9cea9f', '603a4f39-f740-4aaa-8d3b-2e6f31f15428', '664ca845-9ae0-482b-b26e-67c742e23adb', '45d63636-d9dd-472c-90a5-4fbd97d225cc'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:51 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:51 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-81de6a5b-58ef-491c-8506-848382d7b9e4-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-81de6a5b-58ef-491c-8506-848382d7b9e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "cinder-quobyte-81de6a5b-58ef-491c-8506-848382d7b9e4" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-81de6a5b-58ef-491c-8506-848382d7b9e4" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7668749-fc4b-4e65-80de-1338e9dae4e4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:04:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:51 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 Jul 09 17:04:51 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:52 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:52 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:52 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Deleted volume successfully. Jul 09 17:04:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d01107b-db3f-4547-a912-171c19fb91db tempest-VolumesTestJSON-1768515832 None] Lock "cinder-c059f575-bdfa-4cd2-bc10-3416b5aca6a5-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:52 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4" returned: 0 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:52 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4 Jul 09 17:04:52 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:53 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-81de6a5b-58ef-491c-8506-848382d7b9e4" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-quobyte-81de6a5b-58ef-491c-8506-848382d7b9e4" released by "delete_volume" :: held 1.696s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Created reservations ['5ba48f36-3cb6-4b22-b521-ccaabd172a2f', '4abaf8e3-c7c2-4e4f-ab20-606d2f8fb1eb', '6db119b1-eadb-41d3-a98e-c885fdd77c78', '1905e9b4-9380-482d-8501-f009d72f5f02'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:04:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:04:53 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:04:53 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:04:54 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Jul 09 17:04:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.725s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:04:54 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:04:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Deleted volume successfully. Jul 09 17:04:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4a14235-f6c8-46c2-9db9-2b0fa3856e87 tempest-VolumesTestJSON-1768515832 None] Lock "cinder-81de6a5b-58ef-491c-8506-848382d7b9e4-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:00 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:05:00 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Flow 'volume_create_manager' (319a4fb1-895c-433a-aaba-6085a674e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdc146b-d909-4d56-b8c9-744d0e66edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdc146b-d909-4d56-b8c9-744d0e66edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-969948191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8485b352-75dd-4d1e-9752-bb300607461f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4775f4aa8ecb4f7a83fecf77e42bad16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:00Z,use_quota=True,user_id='939f7768cd4b4ca19b40cde6c39a918b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5390e618-e761-4f6f-b0f9-55fb5b25f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5390e618-e761-4f6f-b0f9-55fb5b25f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7faff0e3-b998-4dbe-8c7d-4bf40112592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7faff0e3-b998-4dbe-8c7d-4bf40112592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8485b352-75dd-4d1e-9752-bb300607461f', 'volume_name': 'volume-8485b352-75dd-4d1e-9752-bb300607461f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5f370c-ac5d-4640-8890-0ebf862d547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5f370c-ac5d-4640-8890-0ebf862d547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75c5641-282f-417e-9a2f-0bbbc74aa944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:00 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Volume 8485b352-75dd-4d1e-9752-bb300607461f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8485b352-75dd-4d1e-9752-bb300607461f', 'volume_size': 1} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-969948191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8485b352-75dd-4d1e-9752-bb300607461f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4775f4aa8ecb4f7a83fecf77e42bad16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:00Z,use_quota=True,user_id='939f7768cd4b4ca19b40cde6c39a918b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Creating volume 8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:05:00 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:05:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:00 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f 1073741824 Jul 09 17:05:00 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:02 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.605s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:05:02 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f 1073741824" returned: 0 in 1.536s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:02 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f Jul 09 17:05:02 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:03 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f" returned: 0 in 1.397s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] <== create_volume: return (3077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.080s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75c5641-282f-417e-9a2f-0bbbc74aa944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8485b352-75dd-4d1e-9752-bb300607461f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2404e99-9a8f-4a45-a999-4f64f22b55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Volume volume-8485b352-75dd-4d1e-9752-bb300607461f (8485b352-75dd-4d1e-9752-bb300607461f): created successfully Jul 09 17:05:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2404e99-9a8f-4a45-a999-4f64f22b55d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Flow 'volume_create_manager' (319a4fb1-895c-433a-aaba-6085a674e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:04 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a0700258-85e0-4147-bb76-87149e050cf4 tempest-ServerActionsTestOtherA-236025507 None] Created volume successfully. Jul 09 17:05:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce806f9-2c96-4496-990a-539bafbde951 tempest-BackendsCapabilitiesAdminTestsJSON-1114282300 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7536811828613, 'free_capacity_gb': 1775.7536811828613, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86876) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 17:05:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f53736e0-040c-4a06-a8c7-8d3b69832bc0 tempest-BackendsCapabilitiesAdminTestsJSON-1114282300 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7536811828613, 'free_capacity_gb': 1775.7536811828613, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86876) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Acquiring lock "cinder-f5a61ae0-f55e-4773-a5ae-846323ee94fb-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "cinder-f5a61ae0-f55e-4773-a5ae-846323ee94fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Acquiring lock "cinder-quobyte-f5a61ae0-f55e-4773-a5ae-846323ee94fb" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "cinder-quobyte-f5a61ae0-f55e-4773-a5ae-846323ee94fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52a5f1-d94e-46d5-8311-84a8d0cfd6c2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:09 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb Jul 09 17:05:09 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:09 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb" returned: 0 in 0.797s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:09 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb Jul 09 17:05:09 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:10 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f5a61ae0-f55e-4773-a5ae-846323ee94fb" returned: 0 in 0.633s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "cinder-quobyte-f5a61ae0-f55e-4773-a5ae-846323ee94fb" released by "delete_volume" :: held 1.486s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Created reservations ['d015ae26-1658-4a16-91bd-414635374801', '06e88344-b3fb-4f34-8424-25abc568b2e0', '05694eb2-4abe-47cc-a871-78c3b4114d0c', 'f1e8e31e-9038-4add-a17b-668c223f3812'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:10 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:05:10 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:11 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:11 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:05:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Deleted volume successfully. Jul 09 17:05:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1902d058-b1fc-4437-94a6-52501ef3ec89 tempest-AttachVolumeShelveTestJSON-1104423269 None] Lock "cinder-f5a61ae0-f55e-4773-a5ae-846323ee94fb-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=41,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (e60b29fa-f2aa-4ea6-8114-1feb5586f04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086b44c9-8129-46e4-a4c1-50990a3f1087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086b44c9-8129-46e4-a4c1-50990a3f1087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1111591659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8e7ed4-df32-459a-944f-78540d7738a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:17Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8320f603-ce6f-4896-9024-80f350319972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8320f603-ce6f-4896-9024-80f350319972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fa8d07-cd0d-46a7-b54a-a373bc38fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fa8d07-cd0d-46a7-b54a-a373bc38fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8e7ed4-df32-459a-944f-78540d7738a2', 'volume_name': 'volume-fe8e7ed4-df32-459a-944f-78540d7738a2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a752a907-4f33-4383-82e8-b48b3aeb23e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a752a907-4f33-4383-82e8-b48b3aeb23e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9774a1c9-6032-4384-8c03-1ff2744ca108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Volume fe8e7ed4-df32-459a-944f-78540d7738a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8e7ed4-df32-459a-944f-78540d7738a2', 'volume_size': 1} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1111591659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8e7ed4-df32-459a-944f-78540d7738a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:17Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Creating volume fe8e7ed4-df32-459a-944f-78540d7738a2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:05:16 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:05:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:17 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 1073741824 Jul 09 17:05:17 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:17 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 1073741824" returned: 0 in 0.891s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:18 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 Jul 09 17:05:18 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:18 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2" returned: 0 in 0.800s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9774a1c9-6032-4384-8c03-1ff2744ca108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8e7ed4-df32-459a-944f-78540d7738a2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8291fd71-69d1-49ad-b84d-dc87b6cae7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Volume volume-fe8e7ed4-df32-459a-944f-78540d7738a2 (fe8e7ed4-df32-459a-944f-78540d7738a2): created successfully Jul 09 17:05:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8291fd71-69d1-49ad-b84d-dc87b6cae7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (e60b29fa-f2aa-4ea6-8114-1feb5586f04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3ed40d20-cc19-40a5-bd89-615ab426d9e3 tempest-AttachVolumeNegativeTest-1647098669 None] Created volume successfully. Jul 09 17:05:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-add706e2-7b1d-49d8-9f8b-7c8e92ff5755 tempest-GroupsTest-1356048335 None] Group tempest-Group1-1187374931: creating Jul 09 17:05:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-add706e2-7b1d-49d8-9f8b-7c8e92ff5755 tempest-GroupsTest-1356048335 None] Group tempest-Group1-1187374931: created successfully Jul 09 17:05:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-add706e2-7b1d-49d8-9f8b-7c8e92ff5755 tempest-GroupsTest-1356048335 None] Create group completed successfully. Jul 09 17:05:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40610a-73ab-4c32-bc5c-a1b88fa53649]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:23 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 Jul 09 17:05:23 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2433fc8-1d40-4c3d-b4e0-b540575c66cd tempest-GroupsTest-1356048335 None] Group tempest-Group2-1204952167: creating Jul 09 17:05:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2433fc8-1d40-4c3d-b4e0-b540575c66cd tempest-GroupsTest-1356048335 None] Group tempest-Group2-1204952167: created successfully Jul 09 17:05:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2433fc8-1d40-4c3d-b4e0-b540575c66cd tempest-GroupsTest-1356048335 None] Create group completed successfully. Jul 09 17:05:24 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2" returned: 0 in 1.092s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.111s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-fe8e7ed4-df32-459a-944f-78540d7738a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bde1618-dbcb-4c1d-ba2f-73dcdc55cb9b', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:05:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-c6d6e5c7-4280-4772-a4c7-1397c5662a37 req-3ca41180-5cd0-4517-90c9-d8db796bef6a tempest-AttachVolumeNegativeTest-1647098669 None] attachment_update completed successfully. Jul 09 17:05:25 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:05:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (5eedf511-0a20-45e7-80ce-92970ca26b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de86ec33-bb29-437c-8ec4-f345da327915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de86ec33-bb29-437c-8ec4-f345da327915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951722042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe56a22-73b5-47d9-a869-24e90acafcb6,host='devstack@QuobyteHD#QuobyteHD',id=f4f5ebb1-12ec-4249-abf7-76b417bfd8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:26Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a47b6647-9bc6-4076-800f-f74261a459e9),volume_type_id=a47b6647-9bc6-4076-800f-f74261a459e9)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8971d559-9410-415d-8846-102c51fa50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8971d559-9410-415d-8846-102c51fa50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce51f622-6643-471f-92dd-b7da43b51975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce51f622-6643-471f-92dd-b7da43b51975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f5ebb1-12ec-4249-abf7-76b417bfd8f1', 'volume_name': 'volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1011ed1-58e4-4b07-b3ee-13e716581809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1011ed1-58e4-4b07-b3ee-13e716581809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e12b89-5c1c-43c8-a47f-4286f886cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Volume f4f5ebb1-12ec-4249-abf7-76b417bfd8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1', 'volume_size': 1} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbe56a22-73b5-47d9-a869-24e90acafcb6,created_at=2026-07-09T15:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951722042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe56a22-73b5-47d9-a869-24e90acafcb6,host='devstack@QuobyteHD#QuobyteHD',id=f4f5ebb1-12ec-4249-abf7-76b417bfd8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:26Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a47b6647-9bc6-4076-800f-f74261a459e9),volume_type_id=a47b6647-9bc6-4076-800f-f74261a459e9)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Creating volume f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:05:26 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:05:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:26 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 1073741824 Jul 09 17:05:26 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:27 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 1073741824" returned: 0 in 1.495s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:27 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 Jul 09 17:05:27 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:28 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" returned: 0 in 1.167s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] <== create_volume: return (2726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.728s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e12b89-5c1c-43c8-a47f-4286f886cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1084b20e-17b3-485e-9dac-50690092b32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Volume volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 (f4f5ebb1-12ec-4249-abf7-76b417bfd8f1): created successfully Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1084b20e-17b3-485e-9dac-50690092b32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (5eedf511-0a20-45e7-80ce-92970ca26b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aac9a4a9-cd94-4bab-a658-537cfc1afe7c tempest-GroupsTest-1356048335 None] Created volume successfully. Jul 09 17:05:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Acquiring lock "cinder-quobyte-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:05:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:05:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ed918-235a-4a08-adb5-f72efce50315]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:31 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 Jul 09 17:05:31 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-574864a5-9dda-4430-83d3-f601dc80aabf req-cbd606db-a596-48d4-9307-e7fd48f0d368 tempest-AttachVolumeNegativeTest-1647098669 None] Terminate volume connection completed successfully. Jul 09 17:05:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-574864a5-9dda-4430-83d3-f601dc80aabf req-cbd606db-a596-48d4-9307-e7fd48f0d368 tempest-AttachVolumeNegativeTest-1647098669 None] Deleting attachment 9bde1618-dbcb-4c1d-ba2f-73dcdc55cb9b. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:05:32 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" returned: 0 in 1.394s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:32 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1 Jul 09 17:05:32 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:33 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" returned: 0 in 0.803s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-f4f5ebb1-12ec-4249-abf7-76b417bfd8f1" released by "delete_volume" :: held 2.294s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Created reservations ['3b282217-bed8-4d58-ae6f-dc27b054803c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:33 devstack cinder-volume[86876]: WARNING cinder.quota [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1450879631 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1450879631, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:05:33 devstack cinder-volume[86876]: WARNING cinder.quota [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1450879631 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1450879631, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Created reservations ['a77e0827-1505-47b9-8884-62d26852da27', 'e38a0509-47c5-4ec1-8276-e059997c91dc', 'ba4b5939-710d-470e-b4bb-066882fec73a', '34c15fb3-82b4-40e3-baae-1cacecd9df68'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:33 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:05:33 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Created reservations ['6fcacaaa-b6ff-4873-874b-fdfc51c7abe0'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:34 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:05:34 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:34 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.325s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:05:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-91339a57-52e8-4a52-83bd-c181afe40110 tempest-GroupsTest-1356048335 None] Delete group completed successfully. Jul 09 17:05:34 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.976s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:34 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:05:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-11422fca-d802-4001-a4df-cb0d789b0b02 tempest-GroupsTest-1356048335 None] Delete group completed successfully. Jul 09 17:05:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c9f339c7-4d56-4f1e-b4ab-5b13fef029f9 tempest-GroupsTest-1356048335 None] Group tempest-GroupsTest-Group-2104387412: creating Jul 09 17:05:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c9f339c7-4d56-4f1e-b4ab-5b13fef029f9 tempest-GroupsTest-1356048335 None] Group tempest-GroupsTest-Group-2104387412: created successfully Jul 09 17:05:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c9f339c7-4d56-4f1e-b4ab-5b13fef029f9 tempest-GroupsTest-1356048335 None] Create group completed successfully. Jul 09 17:05:37 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:05:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (9a11b1db-2f8d-4aff-a529-cfa33ca0cd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec5282-301c-4a34-a2ed-06a88cc52704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec5282-301c-4a34-a2ed-06a88cc52704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406134809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b68a19-d776-426c-a77d-437d670fc15b,host='devstack@QuobyteHD#QuobyteHD',id=02bd3007-d20f-42e2-910f-a1d4cd5fbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:38Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35),volume_type_id=5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8184c9-b992-4d74-bb1c-33287f5cf55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8184c9-b992-4d74-bb1c-33287f5cf55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beef692f-775a-493f-8ab5-837078acd14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beef692f-775a-493f-8ab5-837078acd14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02bd3007-d20f-42e2-910f-a1d4cd5fbd6e', 'volume_name': 'volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3223fd-fdaf-4046-b18f-b1f4d14d4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3223fd-fdaf-4046-b18f-b1f4d14d4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6561fbff-8ea6-4496-8df0-4ecb177ffb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:38 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Volume 02bd3007-d20f-42e2-910f-a1d4cd5fbd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e', 'volume_size': 1} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14b68a19-d776-426c-a77d-437d670fc15b,created_at=2026-07-09T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406134809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b68a19-d776-426c-a77d-437d670fc15b,host='devstack@QuobyteHD#QuobyteHD',id=02bd3007-d20f-42e2-910f-a1d4cd5fbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:38Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35),volume_type_id=5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Creating volume 02bd3007-d20f-42e2-910f-a1d4cd5fbd6e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:05:38 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:05:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:38 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e 1073741824 Jul 09 17:05:38 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:38 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e 1073741824" returned: 0 in 0.909s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:39 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e Jul 09 17:05:39 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:39 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" returned: 0 in 0.745s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6561fbff-8ea6-4496-8df0-4ecb177ffb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b50ae75-7b48-4e66-a501-43ac7e6b5191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Volume volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e (02bd3007-d20f-42e2-910f-a1d4cd5fbd6e): created successfully Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b50ae75-7b48-4e66-a501-43ac7e6b5191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (9a11b1db-2f8d-4aff-a529-cfa33ca0cd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c1aac798-bed7-46e0-8df8-7d1626244d00 tempest-GroupsTest-1356048335 None] Created volume successfully. Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (34860e06-6498-4205-b6a9-db324bdb97ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6fdf7b-d6e6-4440-88c2-f94f0401599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6fdf7b-d6e6-4440-88c2-f94f0401599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-742396465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b68a19-d776-426c-a77d-437d670fc15b,host='devstack@QuobyteHD#QuobyteHD',id=1355c940-eaca-43fb-bf23-67f39966e0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:41Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35),volume_type_id=5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec7a9ed-e6f5-4f15-9359-c248667915f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec7a9ed-e6f5-4f15-9359-c248667915f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d202f8f-e578-4e37-8426-126f7e6b5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d202f8f-e578-4e37-8426-126f7e6b5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1355c940-eaca-43fb-bf23-67f39966e0d8', 'volume_name': 'volume-1355c940-eaca-43fb-bf23-67f39966e0d8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ba1a00-58b6-4794-b2c1-bd5093007dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ba1a00-58b6-4794-b2c1-bd5093007dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94df0ab7-2f1d-4514-b45c-c3ddd3a53aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Volume 1355c940-eaca-43fb-bf23-67f39966e0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1355c940-eaca-43fb-bf23-67f39966e0d8', 'volume_size': 1} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14b68a19-d776-426c-a77d-437d670fc15b,created_at=2026-07-09T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-742396465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b68a19-d776-426c-a77d-437d670fc15b,host='devstack@QuobyteHD#QuobyteHD',id=1355c940-eaca-43fb-bf23-67f39966e0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552ad31d1261417f81b550b77c954449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:05:41Z,use_quota=True,user_id='1bd2d1cbd5f749c68fd373629e922ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35),volume_type_id=5bab7b78-2bb9-421f-a1ce-0afb4e7ffb35)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Creating volume 1355c940-eaca-43fb-bf23-67f39966e0d8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:05:40 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:05:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:40 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 1073741824 Jul 09 17:05:40 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:41 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 1073741824" returned: 0 in 0.828s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:41 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 Jul 09 17:05:41 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:42 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94df0ab7-2f1d-4514-b45c-c3ddd3a53aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1355c940-eaca-43fb-bf23-67f39966e0d8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633e9b68-0e68-4235-88ff-af87e39d07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:05:42 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Volume volume-1355c940-eaca-43fb-bf23-67f39966e0d8 (1355c940-eaca-43fb-bf23-67f39966e0d8): created successfully Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633e9b68-0e68-4235-88ff-af87e39d07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:05:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Flow 'volume_create_manager' (34860e06-6498-4205-b6a9-db324bdb97ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:05:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3eaef944-f2ac-4fe4-8951-1e51413104a6 tempest-GroupsTest-1356048335 None] Created volume successfully. Jul 09 17:05:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d8c8d89e-681a-4a87-8c62-3ec3800c1213 tempest-GroupsTest-1356048335 None] Update group completed successfully. Jul 09 17:05:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-be6a0db9-c18f-4a30-97d4-700f7c7b9e68 tempest-GroupsTest-1356048335 None] Update group completed successfully. Jul 09 17:05:46 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:DELETE=5,cinder:UPDATE=68,cinder:SELECT=58,cinder:INSERT=15 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:05:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Acquiring lock "cinder-quobyte-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:05:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" acquired by "delete_volume" :: waited 0.052s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:05:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fdc7ed-5118-4f7b-9baf-45c82f631cbb]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:47 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e Jul 09 17:05:47 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:47 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" returned: 0 in 0.904s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:47 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e Jul 09 17:05:47 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:48 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" returned: 0 in 0.717s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-02bd3007-d20f-42e2-910f-a1d4cd5fbd6e" released by "delete_volume" :: held 1.678s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Acquiring lock "cinder-quobyte-1355c940-eaca-43fb-bf23-67f39966e0d8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-1355c940-eaca-43fb-bf23-67f39966e0d8" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f146945-df86-4d01-9c85-1d5e3f594ec9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:48 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 Jul 09 17:05:48 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:49 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8" returned: 0 in 0.766s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:49 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8 Jul 09 17:05:49 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:50 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1355c940-eaca-43fb-bf23-67f39966e0d8" returned: 0 in 0.672s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "cinder-quobyte-1355c940-eaca-43fb-bf23-67f39966e0d8" released by "delete_volume" :: held 1.498s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Created reservations ['d9339846-e53a-4967-87bb-4c4cd1b9793e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:50 devstack cinder-volume[86876]: WARNING cinder.quota [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-445042038 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-445042038, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:05:50 devstack cinder-volume[86876]: WARNING cinder.quota [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-445042038 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-445042038, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Created reservations ['c43460ed-f9b3-43d1-b75c-189c4d034479', '9f024b55-ce72-4159-86d6-2e7921b565d7', '9f618fe0-e51c-4e2b-8c3b-ec1a5b2e4282', 'd2fd6b9e-6367-4bb8-a143-556b8df32e03'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Created reservations ['0314c772-6d8e-4cc0-a172-d565db1b3d21', '6415c85f-6b68-413d-83ba-469d8ed1018d', '83d3c2c6-cd79-4837-bd93-d20720714a1e', '5688875f-ad7f-4f90-bc6e-5619817d2161'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:50 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:05:50 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:51 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.667s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:51 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:05:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2747f700-5c51-45da-8ac9-19e5840d1626 tempest-GroupsTest-1356048335 None] Delete group completed successfully. Jul 09 17:05:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:05:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:05:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac6e5fe-3e9a-4a88-b17e-8470dce009da]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:05:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:05:54 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f Jul 09 17:05:54 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:05:54 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 09 17:05:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f" returned: 0 in 1.023s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:05:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.065s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:05:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-8485b352-75dd-4d1e-9752-bb300607461f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b520a72-fcf7-45d9-ba9b-db7297978ab5', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:05:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-09ff6e0f-03e2-4da6-a7ca-ee54c72298b7 req-126ad725-c265-4f91-837b-e80de2578fe4 tempest-ServerActionsTestOtherA-236025507 None] attachment_update completed successfully. Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:00 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:06:00 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:02 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.567s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:02 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:06:02 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:06:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:06:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:06:05 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=48,cinder:SELECT=54,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:06:05 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=20,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:06:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-cd16c2f9-7e6c-4c84-9562-60ed84f7629f tempest-ServerActionsTestOtherA-236025507 None] Terminate volume connection completed successfully. Jul 09 17:06:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-cd16c2f9-7e6c-4c84-9562-60ed84f7629f tempest-ServerActionsTestOtherA-236025507 None] Deleting attachment 4b520a72-fcf7-45d9-ba9b-db7297978ab5. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:06:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:08 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf04595-ce7c-4f21-b755-f1cfad55bcef]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:08 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f Jul 09 17:06:08 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:09 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f" returned: 0 in 0.961s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-8485b352-75dd-4d1e-9752-bb300607461f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dca4a52c-d572-4eaa-828a-441e85a70016', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:06:09 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-c523f797-c14b-46d2-bc77-cb09b72bb85f req-3c54159a-f903-40eb-aa02-116caa14b028 tempest-ServerActionsTestOtherA-236025507 None] attachment_update completed successfully. Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Flow 'volume_create_manager' (bc519ccf-718a-4ccd-831b-b3fd123246d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71350903-e3c1-49d8-b67d-9918885b9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71350903-e3c1-49d8-b67d-9918885b9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-247869314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed48a3f6-2801-4434-8159-3965ce737658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337d7e6ae57d457380c9e1b1d5d5c448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:19Z,use_quota=True,user_id='52df92f0c8f44e168ca6ad35d8aef465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44637dc9-ad23-4496-9876-98735b65002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44637dc9-ad23-4496-9876-98735b65002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a7c879-8a91-458f-859b-30eaf4929f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a7c879-8a91-458f-859b-30eaf4929f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed48a3f6-2801-4434-8159-3965ce737658', 'volume_name': 'volume-ed48a3f6-2801-4434-8159-3965ce737658', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48aa39ad-4264-47b9-9e0a-f807ac253d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48aa39ad-4264-47b9-9e0a-f807ac253d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ca714-84f8-40fd-a5c2-643623472e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Volume ed48a3f6-2801-4434-8159-3965ce737658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed48a3f6-2801-4434-8159-3965ce737658', 'volume_size': 1} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-247869314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed48a3f6-2801-4434-8159-3965ce737658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337d7e6ae57d457380c9e1b1d5d5c448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:19Z,use_quota=True,user_id='52df92f0c8f44e168ca6ad35d8aef465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Creating volume ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:06:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:06:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:19 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 1073741824 Jul 09 17:06:19 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:20 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 1073741824" returned: 0 in 0.827s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:20 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 Jul 09 17:06:20 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:21 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658" returned: 0 in 0.753s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ca714-84f8-40fd-a5c2-643623472e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed48a3f6-2801-4434-8159-3965ce737658', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d6304d-8b3b-4260-9a85-44f1ef0a4971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Volume volume-ed48a3f6-2801-4434-8159-3965ce737658 (ed48a3f6-2801-4434-8159-3965ce737658): created successfully Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d6304d-8b3b-4260-9a85-44f1ef0a4971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Flow 'volume_create_manager' (bc519ccf-718a-4ccd-831b-b3fd123246d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-65fc2bee-b3a9-4230-88c2-5ca1d674ccaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Created volume successfully. Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (4655df53-6002-43e6-ae3a-4b6c81e74e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8de237-d7dc-448a-a89e-6763296dcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8de237-d7dc-448a-a89e-6763296dcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-463772051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a312cc4-738a-4f68-992d-3f2ca505b57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:21Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84985407-bda1-4e0c-b86c-316aa26e7366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84985407-bda1-4e0c-b86c-316aa26e7366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e957a1-2ea1-4aa7-88a5-ec4c8ffb9396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e957a1-2ea1-4aa7-88a5-ec4c8ffb9396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a312cc4-738a-4f68-992d-3f2ca505b57e', 'volume_name': 'volume-8a312cc4-738a-4f68-992d-3f2ca505b57e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b652221-9405-45ab-8c9c-45e0d5e33b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b652221-9405-45ab-8c9c-45e0d5e33b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62248a3b-31a6-489b-b7cf-501a7d2e78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Volume 8a312cc4-738a-4f68-992d-3f2ca505b57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a312cc4-738a-4f68-992d-3f2ca505b57e', 'volume_size': 1} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-463772051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a312cc4-738a-4f68-992d-3f2ca505b57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:21Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Creating volume 8a312cc4-738a-4f68-992d-3f2ca505b57e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:06:21 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:21 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e 1073741824 Jul 09 17:06:21 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:22 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e 1073741824" returned: 0 in 0.910s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:22 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e Jul 09 17:06:22 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:22 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e" returned: 0 in 0.679s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.283s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62248a3b-31a6-489b-b7cf-501a7d2e78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a312cc4-738a-4f68-992d-3f2ca505b57e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adb6e2-1c74-4b86-b866-767738baaa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Creating offline snapshot 9a2d5edb-a1c0-4999-aae1-59a34e45904f of volume ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:06:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Volume volume-8a312cc4-738a-4f68-992d-3f2ca505b57e (8a312cc4-738a-4f68-992d-3f2ca505b57e): created successfully Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adb6e2-1c74-4b86-b866-767738baaa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (4655df53-6002-43e6-ae3a-4b6c81e74e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687d770-0e2b-46c4-9a98-f07adafffcfb]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ecb67af0-fa08-4f1f-a076-970e82f53f1f tempest-AttachVolumeTestJSON-1403084940 None] Created volume successfully. Jul 09 17:06:23 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 Jul 09 17:06:23 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:23 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658" returned: 0 in 0.802s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:23 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f 1G Jul 09 17:06:23 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:24 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f 1G" returned: 0 in 0.835s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed48a3f6-2801-4434-8159-3965ce737658 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:24 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed48a3f6-2801-4434-8159-3965ce737658 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f Jul 09 17:06:24 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:25 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed48a3f6-2801-4434-8159-3965ce737658 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f" returned: 0 in 0.677s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:25 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f is being set with open permissions: ugo+rw Jul 09 17:06:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:25 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f Jul 09 17:06:25 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:26 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f" returned: 0 in 0.663s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:26 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info Jul 09 17:06:26 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (b5a9a8ee-e2a7-4245-b473-4d77b63bd1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cdeeb3-7bc6-4655-9173-a1ea1d22dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cdeeb3-7bc6-4655-9173-a1ea1d22dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1224578067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ecf58-8103-4810-8189-c80cb9ed7c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:27Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1595449f-be77-40fc-995d-c0053aa845be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1595449f-be77-40fc-995d-c0053aa845be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461fb995-9b27-47a7-97d8-f5848c7d81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461fb995-9b27-47a7-97d8-f5848c7d81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1ecf58-8103-4810-8189-c80cb9ed7c92', 'volume_name': 'volume-df1ecf58-8103-4810-8189-c80cb9ed7c92', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58824a9-e0be-411a-8bca-c1846a1ba633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58824a9-e0be-411a-8bca-c1846a1ba633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82b7215-8ff5-4687-b3a7-d249ff3616b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Volume df1ecf58-8103-4810-8189-c80cb9ed7c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1ecf58-8103-4810-8189-c80cb9ed7c92', 'volume_size': 1} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:26 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info" returned: 0 in 0.867s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:26 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info is being set with open permissions: ugo+rw Jul 09 17:06:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:26 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info Jul 09 17:06:26 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:27 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.info" returned: 0 in 0.672s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.659s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1224578067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ecf58-8103-4810-8189-c80cb9ed7c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73290d74eae24e32a6302add73f97a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:27Z,use_quota=True,user_id='0d51afec369e4a8681f4c885ae70f331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Creating volume df1ecf58-8103-4810-8189-c80cb9ed7c92 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:06:27 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:06:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:27 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 1073741824 Jul 09 17:06:27 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ac83b437-ccbf-4d03-b429-291300eafff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Create snapshot completed successfully Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "cinder-9a2d5edb-a1c0-4999-aae1-59a34e45904f-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-9a2d5edb-a1c0-4999-aae1-59a34e45904f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "cinder-quobyte-9a2d5edb-a1c0-4999-aae1-59a34e45904f" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-9a2d5edb-a1c0-4999-aae1-59a34e45904f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Deleting offline snapshot 9a2d5edb-a1c0-4999-aae1-59a34e45904f of volume ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] snapshot_file for this snap is: volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a1a32-c5fe-4141-aa38-61eebfd539ae]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:28 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 1073741824" returned: 0 in 0.981s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:28 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 Jul 09 17:06:28 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:28 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f Jul 09 17:06:28 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:29 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.676s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82b7215-8ff5-4687-b3a7-d249ff3616b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1ecf58-8103-4810-8189-c80cb9ed7c92', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170fa4b1-6b2c-44cb-b3f2-eba172185d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d931c-5258-4b49-8e05-8be75866643f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:29 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f" returned: 0 in 0.867s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed48a3f6-2801-4434-8159-3965ce737658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:06:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Volume volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 (df1ecf58-8103-4810-8189-c80cb9ed7c92): created successfully Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170fa4b1-6b2c-44cb-b3f2-eba172185d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Flow 'volume_create_manager' (b5a9a8ee-e2a7-4245-b473-4d77b63bd1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da1c3f-0290-4a13-b45e-ed9b45420060]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ebb3fb6e-6e5a-4834-9fb8-148c64b99c75 tempest-AttachVolumeNegativeTest-1647098669 None] Created volume successfully. Jul 09 17:06:29 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e Jul 09 17:06:29 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:29 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 Jul 09 17:06:29 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:30 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e" returned: 0 in 0.896s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-8a312cc4-738a-4f68-992d-3f2ca505b57e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f9a64f-87e3-4e77-955e-67353a9c9cfd', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:06:30 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658" returned: 0 in 0.886s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:30 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f Jul 09 17:06:30 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-287e0674-1655-47cf-a45a-4413763d78ea req-271823f4-0853-429f-9eee-2274daf3c71d tempest-AttachVolumeTestJSON-1403084940 None] attachment_update completed successfully. Jul 09 17:06:31 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f" returned: 0 in 0.829s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:31 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f Jul 09 17:06:31 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:31 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658.9a2d5edb-a1c0-4999-aae1-59a34e45904f" returned: 0 in 0.704s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-9a2d5edb-a1c0-4999-aae1-59a34e45904f" released by "_delete_snapshot" :: held 3.435s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" released by "delete_snapshot" :: held 3.483s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:32 devstack cinder-volume[86876]: WARNING cinder.quota [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Created reservations ['2f1814eb-9cb9-45b1-8ab5-efa6840f3890', '79eda3b7-ac1c-4823-abcb-fbd33ce8fe4d', '4d1c8423-acbe-4a97-b7f5-1a47c424b1e1', '37794f99-f112-42f6-a238-1a793fd668fb'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:06:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Delete snapshot completed successfully. Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c1a3a397-ea34-4ecc-b4ff-0286a47c3d4e tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-9a2d5edb-a1c0-4999-aae1-59a34e45904f-delete_snapshot" released by "delete_snapshot" :: held 3.711s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "cinder-ed48a3f6-2801-4434-8159-3965ce737658-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-ed48a3f6-2801-4434-8159-3965ce737658-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[23797787-fafd-440a-a99e-17d95aa385a8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c20e7-51ec-4c66-bbef-f4d99b736df3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:33 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 Jul 09 17:06:33 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:33 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 Jul 09 17:06:33 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:33 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92" returned: 0 in 0.742s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-df1ecf58-8103-4810-8189-c80cb9ed7c92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c265d48a-e5a6-4329-be82-24569d3ba82f', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:06:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-63fff789-e121-4bdc-9ee8-6103421d2647 req-af0a0104-a5bd-41b8-af6b-fc9d2dcc2fed tempest-AttachVolumeNegativeTest-1647098669 None] attachment_update completed successfully. Jul 09 17:06:33 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:33 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658 Jul 09 17:06:33 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:34 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ed48a3f6-2801-4434-8159-3965ce737658" returned: 0 in 0.662s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-quobyte-ed48a3f6-2801-4434-8159-3965ce737658" released by "delete_volume" :: held 1.540s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Created reservations ['5c85d97b-561a-424b-8038-885b87890d11', 'e80283f6-3c30-4647-a9c9-a5b02fbc4a8b', 'c226fd31-aca7-4d57-94c9-fcb9aec8afc1', '02212441-26c1-41ae-81f7-ee2296059c8e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:34 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:06:34 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:35 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:35 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:06:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Deleted volume successfully. Jul 09 17:06:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-38662c80-753d-424d-9bfe-5ed6f6bbacc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690991117 None] Lock "cinder-ed48a3f6-2801-4434-8159-3965ce737658-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-3623cae2-8d1b-42b4-854f-0a24028de54a req-9cc0c263-5d60-422d-b390-7c711b10be71 tempest-AttachVolumeNegativeTest-1647098669 None] Terminate volume connection completed successfully. Jul 09 17:06:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-3623cae2-8d1b-42b4-854f-0a24028de54a req-9cc0c263-5d60-422d-b390-7c711b10be71 tempest-AttachVolumeNegativeTest-1647098669 None] Deleting attachment c265d48a-e5a6-4329-be82-24569d3ba82f. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Flow 'volume_create_manager' (e44ba669-5f8a-4638-9fc6-587423d8f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10db8cd-2a26-4b71-b954-f8ed3508aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10db8cd-2a26-4b71-b954-f8ed3508aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-404479575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df1a291-0a4b-4730-8f15-eddafdaf682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91aa791413284746a6176818c9cdc2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:49Z,use_quota=True,user_id='25cc077762cd4800a17043c16d1f4b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0670080-ed4d-47ea-9676-32d2676e9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0670080-ed4d-47ea-9676-32d2676e9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acbf7c9-8834-4dda-bb3a-0ee1db820cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acbf7c9-8834-4dda-bb3a-0ee1db820cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df1a291-0a4b-4730-8f15-eddafdaf682f', 'volume_name': 'volume-8df1a291-0a4b-4730-8f15-eddafdaf682f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436e1c2-42e1-40d5-b840-752416526e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c436e1c2-42e1-40d5-b840-752416526e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cd7d8d-700e-417b-bcfb-539df2e65a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Volume 8df1a291-0a4b-4730-8f15-eddafdaf682f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df1a291-0a4b-4730-8f15-eddafdaf682f', 'volume_size': 1} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-404479575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df1a291-0a4b-4730-8f15-eddafdaf682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91aa791413284746a6176818c9cdc2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:49Z,use_quota=True,user_id='25cc077762cd4800a17043c16d1f4b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Creating volume 8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:06:48 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:06:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:48 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f 1073741824 Jul 09 17:06:48 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:49 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f 1073741824" returned: 0 in 1.019s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:49 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:06:49 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:50 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cd7d8d-700e-417b-bcfb-539df2e65a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df1a291-0a4b-4730-8f15-eddafdaf682f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c9c242-5810-4d63-abc0-970038a291ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Volume volume-8df1a291-0a4b-4730-8f15-eddafdaf682f (8df1a291-0a4b-4730-8f15-eddafdaf682f): created successfully Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c9c242-5810-4d63-abc0-970038a291ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Flow 'volume_create_manager' (e44ba669-5f8a-4638-9fc6-587423d8f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-11861481-1e8a-45c6-8ede-c6b043a59574 tempest-VolumesCloneTest-1483925427 None] Created volume successfully. Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-df1ecf58-8103-4810-8189-c80cb9ed7c92-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-df1ecf58-8103-4810-8189-c80cb9ed7c92-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-quobyte-df1ecf58-8103-4810-8189-c80cb9ed7c92" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-df1ecf58-8103-4810-8189-c80cb9ed7c92" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f38c4-b4bf-49fb-9e68-0ba7975f5869]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:51 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 Jul 09 17:06:51 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Flow 'volume_create_manager' (eaa7dd10-a8e8-4ed7-8edc-f09db167aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d8f4b-caa9-4320-8f3d-7df42c53772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d8f4b-caa9-4320-8f3d-7df42c53772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-467732341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c929f589-78e7-4238-9fd0-cd3fc9a56b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91aa791413284746a6176818c9cdc2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:06:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8df1a291-0a4b-4730-8f15-eddafdaf682f,status='creating',terminated_at=None,updated_at=2026-07-09T15:06:51Z,use_quota=True,user_id='25cc077762cd4800a17043c16d1f4b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760505f4-3981-4eef-8d1a-a45f8f19f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760505f4-3981-4eef-8d1a-a45f8f19f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0aeb926-8537-4fbf-8c37-9b286ace95e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0aeb926-8537-4fbf-8c37-9b286ace95e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c929f589-78e7-4238-9fd0-cd3fc9a56b9c', 'volume_name': 'volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c', 'volume_size': 2, 'source_volid': '8df1a291-0a4b-4730-8f15-eddafdaf682f', 'source_volstatus': 'available'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5db10c7-ca80-4a47-9df3-4547852f5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5db10c7-ca80-4a47-9df3-4547852f5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5598a7a3-5523-4152-8009-da0edf51a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:06:51 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Volume c929f589-78e7-4238-9fd0-cd3fc9a56b9c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c', 'volume_size': 2, 'source_volid': '8df1a291-0a4b-4730-8f15-eddafdaf682f', 'source_volstatus': 'available'} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:51 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Cloning volume 8df1a291-0a4b-4730-8f15-eddafdaf682f to volume c929f589-78e7-4238-9fd0-cd3fc9a56b9c Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Creating offline snapshot c4f5c9b3-98f1-4e7b-b304-a2300619e907 of volume 8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27c8b3-cab4-4788-8dc3-86ce883f4ba8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:51 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:06:51 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:51 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:51 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92 Jul 09 17:06:51 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:52 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 0.844s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:52 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 1G Jul 09 17:06:52 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:52 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-df1ecf58-8103-4810-8189-c80cb9ed7c92" returned: 0 in 0.653s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-df1ecf58-8103-4810-8189-c80cb9ed7c92" released by "delete_volume" :: held 1.547s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Created reservations ['471dd72d-21e8-40d6-a09c-50058f5b4a9a', 'a488cd09-301c-4d02-9f41-140f27d1e5bc', '6d876e1a-69d2-49b1-ac52-849b54b588d9', 'ff3413ca-abd7-4db9-b19d-2e85065cc8e3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:52 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:06:52 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-fe8e7ed4-df32-459a-944f-78540d7738a2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-fe8e7ed4-df32-459a-944f-78540d7738a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-quobyte-fe8e7ed4-df32-459a-944f-78540d7738a2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-fe8e7ed4-df32-459a-944f-78540d7738a2" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:53 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[826e8487-c562-4a5c-8302-65baebd2d1d3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 1G" returned: 0 in 0.895s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df1a291-0a4b-4730-8f15-eddafdaf682f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:53 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:53 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df1a291-0a4b-4730-8f15-eddafdaf682f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:06:53 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:06:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Deleted volume successfully. Jul 09 17:06:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-00947def-ee6e-4655-addb-130d54bd083b tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-df1ecf58-8103-4810-8189-c80cb9ed7c92-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:53 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 Jul 09 17:06:53 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:54 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8df1a291-0a4b-4730-8f15-eddafdaf682f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 0.743s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 is being set with open permissions: ugo+rw Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:54 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2" returned: 0 in 0.777s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:54 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:06:54 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:54 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2 Jul 09 17:06:54 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:54 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe8e7ed4-df32-459a-944f-78540d7738a2" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:54 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-fe8e7ed4-df32-459a-944f-78540d7738a2" released by "delete_volume" :: held 1.538s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Created reservations ['420b0705-670d-4784-a0b4-dcc412395106', '0852d8d6-3ce4-4deb-abfb-e75b6b4e1f84', '0aac58bf-c204-4853-86c4-30ffa6ae7670', 'e106cc30-68c6-4f5a-9bd3-31b74ce654fd'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:06:54 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info Jul 09 17:06:54 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:54 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:06:54 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:55 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info" returned: 0 in 0.745s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:55 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info is being set with open permissions: ugo+rw Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:55 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.687s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:06:55 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info Jul 09 17:06:55 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Deleted volume successfully. Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c513a365-a12e-4bb1-85d0-10174485aa59 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-fe8e7ed4-df32-459a-944f-78540d7738a2-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-d5561ac3-c8c4-43d2-bec7-747ab63a5f61-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-d5561ac3-c8c4-43d2-bec7-747ab63a5f61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "cinder-quobyte-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da5a3d1-edf9-474a-86f1-3d107860933e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:56 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 Jul 09 17:06:56 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:56 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.info" returned: 0 in 0.721s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] snapshot: c4f5c9b3-98f1-4e7b-b304-a2300619e907, volume: c929f589-78e7-4238-9fd0-cd3fc9a56b9c, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6018be-502a-49f8-aa2f-58844dfd1e74]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:56 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:06:56 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:56 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" returned: 0 in 1.024s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:56 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61 Jul 09 17:06:56 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:57 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 1.010s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8df1a291-0a4b-4730-8f15-eddafdaf682f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16fefe2-83ce-47a3-b2cc-e51a87a64bd5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:57 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:06:57 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:57 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-quobyte-d5561ac3-c8c4-43d2-bec7-747ab63a5f61" released by "delete_volume" :: held 1.823s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Created reservations ['e0a52e9a-fcd4-48f3-87a2-b14fe861f193', '038e602c-d85b-47b2-a971-750f5f810371', '9119a1c2-ed1c-4762-98d8-d03095fb3b9b', 'c47c4b95-ac80-4951-be85-dcd21c66536c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:06:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:57 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:06:57 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:58 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 1.064s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:06:58 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c Jul 09 17:06:58 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:06:58 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:06:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Deleted volume successfully. Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-072b102e-d55c-4827-a50a-979c8479c795 tempest-AttachVolumeNegativeTest-1647098669 None] Lock "cinder-d5561ac3-c8c4-43d2-bec7-747ab63a5f61-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:06:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-fc13ed57-79e9-4c07-b8b7-f6f3b813250b req-b654f4b6-8688-47b9-8584-7540d943bb0b tempest-ServerActionsTestOtherA-236025507 None] Terminate volume connection completed successfully. Jul 09 17:06:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-fc13ed57-79e9-4c07-b8b7-f6f3b813250b req-b654f4b6-8688-47b9-8584-7540d943bb0b tempest-ServerActionsTestOtherA-236025507 None] Deleting attachment dca4a52c-d572-4eaa-828a-441e85a70016. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:00 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:00 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:02 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.921s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:02 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:02 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:07:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:07:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:07:05 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" returned: 0 in 7.082s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:05 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[af246940-c088-41a2-83ef-15de645ad217]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:05 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:07:05 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:06 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 1.149s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:06 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:07:06 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Converted 1024.00 MB image at 144.53 MB/s Jul 09 17:07:06 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c is being set with open permissions: ugo+rw Jul 09 17:07:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:06 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c Jul 09 17:07:06 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:07 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" released by "_copy_volume_from_snapshot" :: held 11.143s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=56,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-quobyte-c4f5c9b3-98f1-4e7b-b304-a2300619e907" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c4f5c9b3-98f1-4e7b-b304-a2300619e907" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Deleting offline snapshot c4f5c9b3-98f1-4e7b-b304-a2300619e907 of volume 8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] snapshot_file for this snap is: volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[105c7739-8abc-482d-b222-61766afe581f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:07 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:07:07 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:08 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 0.797s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8df1a291-0a4b-4730-8f15-eddafdaf682f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:07:08 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1407b-4a2e-41de-b964-fcc14be7ce55]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:08 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:07:08 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:09 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 0.771s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:09 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:07:09 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=66,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:07:10 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 0.857s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:10 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907 Jul 09 17:07:10 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:10 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f.c4f5c9b3-98f1-4e7b-b304-a2300619e907" returned: 0 in 0.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c4f5c9b3-98f1-4e7b-b304-a2300619e907" released by "_delete_snapshot" :: held 3.403s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.551s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5598a7a3-5523-4152-8009-da0edf51a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c', 'volume_size': 2, 'source_volid': '8df1a291-0a4b-4730-8f15-eddafdaf682f', 'source_volstatus': 'available'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1114e16-3c2f-450c-aa75-2b3566c1f357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7f2162c1-201e-40c3-bd31-f86368608921 tempest-GroupsV314Test-214092858 None] Group tempest-GroupsV314Test-Group-648907485: creating Jul 09 17:07:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Volume volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c (c929f589-78e7-4238-9fd0-cd3fc9a56b9c): created successfully Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1114e16-3c2f-450c-aa75-2b3566c1f357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Flow 'volume_create_manager' (eaa7dd10-a8e8-4ed7-8edc-f09db167aaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7590873a-e20d-4ae1-8a62-7ab208ea4dd3 tempest-VolumesCloneTest-1483925427 None] Created volume successfully. Jul 09 17:07:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7f2162c1-201e-40c3-bd31-f86368608921 tempest-GroupsV314Test-214092858 None] Group tempest-GroupsV314Test-Group-648907485: created successfully Jul 09 17:07:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7f2162c1-201e-40c3-bd31-f86368608921 tempest-GroupsV314Test-214092858 None] Create group completed successfully. Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-c929f589-78e7-4238-9fd0-cd3fc9a56b9c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-c929f589-78e7-4238-9fd0-cd3fc9a56b9c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a9d6c-d7a6-4a51-9344-0bf8168d00e5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "cinder-8485b352-75dd-4d1e-9752-bb300607461f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "cinder-8485b352-75dd-4d1e-9752-bb300607461f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "cinder-quobyte-8485b352-75dd-4d1e-9752-bb300607461f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "cinder-quobyte-8485b352-75dd-4d1e-9752-bb300607461f" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:11 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c Jul 09 17:07:11 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f941a4c-f8ae-497d-85af-db86dea3b1c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:12 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f Jul 09 17:07:12 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:12 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" returned: 0 in 0.911s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:12 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c Jul 09 17:07:12 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:12 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f" returned: 0 in 0.852s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:12 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f Jul 09 17:07:12 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Flow 'volume_create_manager' (0210dd41-e781-4548-80a2-f339ea46f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0e4fa-ea03-4d2a-b759-98dd4b993154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0e4fa-ea03-4d2a-b759-98dd4b993154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167678113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6913e745-5249-41af-9fea-419f20451559,host='devstack@QuobyteHD#QuobyteHD',id=7dd07acc-8c9c-42ca-b944-875f277e9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315b6f97c5744f06a6fdaf5adfd3fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:13Z,use_quota=True,user_id='241c09ff31364c6cbbc58b2d0efdedba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b993c0a-a3fc-46d7-8443-42892ab35da5),volume_type_id=9b993c0a-a3fc-46d7-8443-42892ab35da5)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12e5500-7a21-4009-b1f8-47110efafdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12e5500-7a21-4009-b1f8-47110efafdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91dee1e5-580a-4fe2-9075-22e3d8e123bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91dee1e5-580a-4fe2-9075-22e3d8e123bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd07acc-8c9c-42ca-b944-875f277e9557', 'volume_name': 'volume-7dd07acc-8c9c-42ca-b944-875f277e9557', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c0cde8-d421-432d-bd18-77da83f14de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c0cde8-d421-432d-bd18-77da83f14de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27c2d6e-862b-4e77-9e6c-3d462107ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Volume 7dd07acc-8c9c-42ca-b944-875f277e9557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd07acc-8c9c-42ca-b944-875f277e9557', 'volume_size': 1} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6913e745-5249-41af-9fea-419f20451559,created_at=2026-07-09T15:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167678113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6913e745-5249-41af-9fea-419f20451559,host='devstack@QuobyteHD#QuobyteHD',id=7dd07acc-8c9c-42ca-b944-875f277e9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315b6f97c5744f06a6fdaf5adfd3fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:13Z,use_quota=True,user_id='241c09ff31364c6cbbc58b2d0efdedba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b993c0a-a3fc-46d7-8443-42892ab35da5),volume_type_id=9b993c0a-a3fc-46d7-8443-42892ab35da5)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Creating volume 7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:07:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:07:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:12 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 1073741824 Jul 09 17:07:12 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:13 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:13 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8485b352-75dd-4d1e-9752-bb300607461f" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-c929f589-78e7-4238-9fd0-cd3fc9a56b9c" released by "delete_volume" :: held 1.799s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "cinder-quobyte-8485b352-75dd-4d1e-9752-bb300607461f" released by "delete_volume" :: held 1.652s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Created reservations ['70016a05-754f-4fbf-92d6-e78374aae22c', '3b92a2c3-8f8a-435a-b892-239ee09185ea', '78904cf8-3156-420e-9d91-e1d43ab8a119', '62e0c40a-bba2-4f8d-a030-0bcc24014665'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Created reservations ['9dc6a353-9fdd-4884-9efc-4cbb7684002f', '2b7a450f-40f4-40d8-a612-6fc71cb8cc41', 'ee0af4ae-dbf8-4176-b34f-1abb21160c3c', '2dd9b01c-d4a7-41da-ae6c-cb6f5af01396'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:13 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:13 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:13 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:13 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-8df1a291-0a4b-4730-8f15-eddafdaf682f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-8df1a291-0a4b-4730-8f15-eddafdaf682f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:14 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 1073741824" returned: 0 in 1.177s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "cinder-quobyte-8df1a291-0a4b-4730-8f15-eddafdaf682f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-8df1a291-0a4b-4730-8f15-eddafdaf682f" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:14 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:14 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2fb2b7-c8fa-463b-8d79-cf272835d7ce]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:14 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:07:14 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:14 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.973s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Deleted volume successfully. Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bf88296e-5fc2-4b6b-a5df-79c624745af6 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-c929f589-78e7-4238-9fd0-cd3fc9a56b9c-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:14 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.047s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Deleted volume successfully. Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8184442b-32d7-4ec8-a0e3-a7ce85af46b3 tempest-ServerActionsTestOtherA-236025507 None] Lock "cinder-8485b352-75dd-4d1e-9752-bb300607461f-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-82c63379-9c9c-4b07-956e-4e42bc4394b2 req-39a69b5e-619b-46a6-8a10-1eddb557aedc tempest-AttachVolumeTestJSON-1403084940 None] Terminate volume connection completed successfully. Jul 09 17:07:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-82c63379-9c9c-4b07-956e-4e42bc4394b2 req-39a69b5e-619b-46a6-8a10-1eddb557aedc tempest-AttachVolumeTestJSON-1403084940 None] Deleting attachment 41f9a64f-87e3-4e77-955e-67353a9c9cfd. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:07:15 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 1.016s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27c2d6e-862b-4e77-9e6c-3d462107ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd07acc-8c9c-42ca-b944-875f277e9557', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2dfc00-9055-414b-8e5d-716074924c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Volume volume-7dd07acc-8c9c-42ca-b944-875f277e9557 (7dd07acc-8c9c-42ca-b944-875f277e9557): created successfully Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2dfc00-9055-414b-8e5d-716074924c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Flow 'volume_create_manager' (0210dd41-e781-4548-80a2-f339ea46f586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f2c48280-080b-45b2-a6e4-c65aca55d97e tempest-GroupsV314Test-214092858 None] Created volume successfully. Jul 09 17:07:15 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 1.079s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:15 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f Jul 09 17:07:15 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:16 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8df1a291-0a4b-4730-8f15-eddafdaf682f" returned: 0 in 0.745s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-quobyte-8df1a291-0a4b-4730-8f15-eddafdaf682f" released by "delete_volume" :: held 1.899s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Created reservations ['883b2e54-a27c-499f-846d-00e2d7d2a9da', '86a49a7f-e00b-4714-8a04-1944006f9244', 'ae6a6d60-d2fa-407e-8b9b-412e49a10884', 'b8088cb6-711d-45a8-9e0a-51aeafebd9e9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:16 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:16 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:17 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.826s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Deleted volume successfully. Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-08f8c17f-549a-4a85-a561-02d0780b7976 tempest-VolumesCloneTest-1483925427 None] Lock "cinder-8df1a291-0a4b-4730-8f15-eddafdaf682f-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:17 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Cloning volume 7dd07acc-8c9c-42ca-b944-875f277e9557 to volume 43c86355-93d1-4397-a053-abdfc7be38bb Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Creating offline snapshot d4be945f-dc61-466d-b7f0-63ffdb6902c0 of volume 7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:07:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879f93e-8530-4aa4-8e6e-a10cd82dfcc7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:18 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:18 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:19 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 1.165s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:19 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 1G Jul 09 17:07:19 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:20 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 1G" returned: 0 in 1.159s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd07acc-8c9c-42ca-b944-875f277e9557 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:20 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd07acc-8c9c-42ca-b944-875f277e9557 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:20 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:21 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd07acc-8c9c-42ca-b944-875f277e9557 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:21 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:07:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:21 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:21 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:21 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.758s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:21 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info Jul 09 17:07:21 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:22 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info" returned: 0 in 0.727s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:22 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:07:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:22 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info Jul 09 17:07:22 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:23 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.info" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Acquiring lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] snapshot: d4be945f-dc61-466d-b7f0-63ffdb6902c0, volume: 43c86355-93d1-4397-a053-abdfc7be38bb, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3059f854-b631-4f54-beef-c2d4357b0f84]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:23 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:23 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (f6983440-063c-4a0a-b125-0743b4d36141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c28b8a-deb9-4c54-8a07-f4891af039a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c28b8a-deb9-4c54-8a07-f4891af039a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013085391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f609b42-87ef-47cc-8ac5-c18107c007aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:24Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf438cd-19c0-4a6e-ba60-46c268fe83fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf438cd-19c0-4a6e-ba60-46c268fe83fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a6b492-17ef-42b9-a5c0-1ceb10e11152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a6b492-17ef-42b9-a5c0-1ceb10e11152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f609b42-87ef-47cc-8ac5-c18107c007aa', 'volume_name': 'volume-6f609b42-87ef-47cc-8ac5-c18107c007aa', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f020d-c64a-4e29-a7c2-5228660a2c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f020d-c64a-4e29-a7c2-5228660a2c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4851341-bb00-4880-a763-5dc1199f5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Volume 6f609b42-87ef-47cc-8ac5-c18107c007aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f609b42-87ef-47cc-8ac5-c18107c007aa', 'volume_size': 1} Jul 09 17:07:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:24 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.885s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd07acc-8c9c-42ca-b944-875f277e9557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd63d0ef-4833-4c9c-a36a-dd8d7a19275a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:24 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:24 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:25 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:25 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:07:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:25 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb Jul 09 17:07:25 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:32 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb" returned: 0 in 7.300s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f817bd-9ea5-442a-a124-ccef8e5399ab]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:32 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:32 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:07:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=35,cinder:INSERT=7,cinder:SELECT=30 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:07:33 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 1.339s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:33 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:07:33 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Converted 1024.00 MB image at 140.22 MB/s Jul 09 17:07:33 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:07:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:33 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb Jul 09 17:07:33 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:34 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb" returned: 0 in 0.676s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" released by "_copy_volume_from_snapshot" :: held 11.085s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Acquiring lock "cinder-quobyte-d4be945f-dc61-466d-b7f0-63ffdb6902c0" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-d4be945f-dc61-466d-b7f0-63ffdb6902c0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Deleting offline snapshot d4be945f-dc61-466d-b7f0-63ffdb6902c0 of volume 7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] snapshot_file for this snap is: volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc84b08c-478b-41d0-8d8e-b0470b30a896]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:34 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:34 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:35 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.805s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd07acc-8c9c-42ca-b944-875f277e9557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:07:35 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[544dd896-e7e9-47ff-ac18-4d0af04ea7da]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:35 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:35 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:36 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 0.858s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:36 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:36 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:37 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:37 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0 Jul 09 17:07:37 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:37 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557.d4be945f-dc61-466d-b7f0-63ffdb6902c0" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-d4be945f-dc61-466d-b7f0-63ffdb6902c0" released by "_delete_snapshot" :: held 3.258s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.933s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.991s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013085391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f609b42-87ef-47cc-8ac5-c18107c007aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:24Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Creating volume 6f609b42-87ef-47cc-8ac5-c18107c007aa {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:07:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:07:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:37 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa 1073741824 Jul 09 17:07:37 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2f1351fd-f4cf-49ff-b2dc-15c1f222f6f9 tempest-GroupsV314Test-214092858 None] Create group from source-group-6913e745-5249-41af-9fea-419f20451559 completed successfully. Jul 09 17:07:38 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa 1073741824" returned: 0 in 1.106s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:39 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa Jul 09 17:07:39 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:39 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa" returned: 0 in 0.843s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Acquiring lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4851341-bb00-4880-a763-5dc1199f5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f609b42-87ef-47cc-8ac5-c18107c007aa', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff171306-d180-4dc9-86d4-11614f0957e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Volume volume-6f609b42-87ef-47cc-8ac5-c18107c007aa (6f609b42-87ef-47cc-8ac5-c18107c007aa): created successfully Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff171306-d180-4dc9-86d4-11614f0957e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (f6983440-063c-4a0a-b125-0743b4d36141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-51aee08c-9d26-4eeb-a5d0-e9ceeffeaf0f tempest-VolumesListTestJSON-716100022 None] Created volume successfully. Jul 09 17:07:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" acquired by "delete_volume" :: waited 0.197s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:40 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fb35cf-3a26-443a-b139-4cd62b0fa6c6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:40 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb Jul 09 17:07:40 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:41 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb" returned: 0 in 1.139s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:41 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb Jul 09 17:07:41 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (2855b155-7062-444c-a545-2e5e46e385c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6d04d2-3f2c-4670-b579-fd023c180041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6d04d2-3f2c-4670-b579-fd023c180041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521463158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa91bd2-00c4-4c78-8dad-545d2ee6a899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:42Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58031446-98dc-4841-89ee-c9d5b11b1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58031446-98dc-4841-89ee-c9d5b11b1403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e8ffd-cfa0-4735-bd97-daf85479a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e8ffd-cfa0-4735-bd97-daf85479a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa91bd2-00c4-4c78-8dad-545d2ee6a899', 'volume_name': 'volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64525783-6a21-4b9f-a302-35781981028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64525783-6a21-4b9f-a302-35781981028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03496fd-d70e-4043-a709-d05caa30501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:41 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Volume 9fa91bd2-00c4-4c78-8dad-545d2ee6a899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899', 'volume_size': 1} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521463158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa91bd2-00c4-4c78-8dad-545d2ee6a899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:42Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Creating volume 9fa91bd2-00c4-4c78-8dad-545d2ee6a899 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:07:42 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:42 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 1073741824 Jul 09 17:07:42 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:42 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-43c86355-93d1-4397-a053-abdfc7be38bb" returned: 0 in 1.092s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-43c86355-93d1-4397-a053-abdfc7be38bb" released by "delete_volume" :: held 2.313s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Created reservations ['d580c52c-0fe8-4fad-a42c-413d681ad708'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:42 devstack cinder-volume[86876]: WARNING cinder.quota [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-915282234 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-915282234, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:07:42 devstack cinder-volume[86876]: WARNING cinder.quota [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-915282234 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-915282234, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:07:42 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Created reservations ['9bd22c76-7857-479c-ad33-965499c81045', 'ee938ca3-1bfb-42ae-94bc-07b56d633572', 'edb1f42b-a1ce-4013-a60e-0b0650d60215', '9791332a-9afd-412a-b601-ce5423cb0357'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:43 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:43 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:43 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 1073741824" returned: 0 in 1.905s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:44 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 Jul 09 17:07:44 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:44 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.016s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aab5e435-842c-4b96-9315-3181394c8465 tempest-GroupsV314Test-214092858 None] Delete group completed successfully. Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Acquiring lock "cinder-quobyte-7dd07acc-8c9c-42ca-b944-875f277e9557" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-7dd07acc-8c9c-42ca-b944-875f277e9557" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3649921e-3e99-4e91-b988-bb793fb5e92e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:44 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:44 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:44 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" returned: 0 in 0.776s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.765s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03496fd-d70e-4043-a709-d05caa30501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc34cc2-af22-49ee-af92-08bd73a79a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:44 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Volume volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 (9fa91bd2-00c4-4c78-8dad-545d2ee6a899): created successfully Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc34cc2-af22-49ee-af92-08bd73a79a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (2855b155-7062-444c-a545-2e5e46e385c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f7b611e2-3765-4ffa-b442-005a61b012ac tempest-VolumesListTestJSON-716100022 None] Created volume successfully. Jul 09 17:07:45 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 0.793s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:45 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557 Jul 09 17:07:45 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (ce5f6488-7350-494b-a89f-de9e2403e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72718a0-00e8-4b56-a825-75b2da6f547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72718a0-00e8-4b56-a825-75b2da6f547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1223855336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3c3516-48e4-487a-bc90-994d6650c055,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:46Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3569289-3ab9-4de3-8c07-04166a50ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3569289-3ab9-4de3-8c07-04166a50ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917025f-1d31-4f27-8349-fbb314b365fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917025f-1d31-4f27-8349-fbb314b365fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3c3516-48e4-487a-bc90-994d6650c055', 'volume_name': 'volume-3a3c3516-48e4-487a-bc90-994d6650c055', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36a7c8e-985c-41df-889a-2180fb76c7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36a7c8e-985c-41df-889a-2180fb76c7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c47f0d4-959a-41da-b9d6-e4c83773beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Volume 3a3c3516-48e4-487a-bc90-994d6650c055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3c3516-48e4-487a-bc90-994d6650c055', 'volume_size': 1} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1223855336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3c3516-48e4-487a-bc90-994d6650c055,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e197161bde0432193e733b3e928d868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:07:46Z,use_quota=True,user_id='c2fc7404d97945959f99da4dd98afc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Creating volume 3a3c3516-48e4-487a-bc90-994d6650c055 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:07:45 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:07:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:45 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 1073741824 Jul 09 17:07:45 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:46 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7dd07acc-8c9c-42ca-b944-875f277e9557" returned: 0 in 0.859s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Lock "cinder-quobyte-7dd07acc-8c9c-42ca-b944-875f277e9557" released by "delete_volume" :: held 1.736s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Created reservations ['ac9d170b-b51a-4090-9447-0393375abe7a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Created reservations ['e07549d1-0e90-4f18-a5d0-2b72acb1cca2', '9ec61a17-8907-4f29-ae31-0260f0df0866', 'de2055f6-8fd5-473b-9d17-b881ec40f291', '2f650c75-c24c-43ed-b5e7-0324057b5664'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:46 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:46 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:46 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 1073741824" returned: 0 in 0.951s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:46 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 Jul 09 17:07:46 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:47 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9e350ade-209a-40ca-9db8-c411208d2c4e tempest-GroupsV314Test-214092858 None] Delete group completed successfully. Jul 09 17:07:47 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055" returned: 0 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c47f0d4-959a-41da-b9d6-e4c83773beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3c3516-48e4-487a-bc90-994d6650c055', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2948fbfd-951c-4456-a79b-891710781894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:07:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Volume volume-3a3c3516-48e4-487a-bc90-994d6650c055 (3a3c3516-48e4-487a-bc90-994d6650c055): created successfully Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2948fbfd-951c-4456-a79b-891710781894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:07:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Flow 'volume_create_manager' (ce5f6488-7350-494b-a89f-de9e2403e68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:07:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4de9daf8-4618-4216-8662-ead25c616223 tempest-VolumesListTestJSON-716100022 None] Created volume successfully. Jul 09 17:07:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-3a3c3516-48e4-487a-bc90-994d6650c055-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "cinder-3a3c3516-48e4-487a-bc90-994d6650c055-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-quobyte-3a3c3516-48e4-487a-bc90-994d6650c055" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-3a3c3516-48e4-487a-bc90-994d6650c055" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a8bfb-047c-4c7d-a7f1-cecb2f431d00]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:52 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 Jul 09 17:07:52 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:52 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:52 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055 Jul 09 17:07:52 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-daebf724-81a2-46a7-b43f-3066b877ddf6 tempest-GroupsV320Test-1920773184 None] Group tempest-GroupsV320Test-Group-1127996029: creating Jul 09 17:07:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-daebf724-81a2-46a7-b43f-3066b877ddf6 tempest-GroupsV320Test-1920773184 None] Group tempest-GroupsV320Test-Group-1127996029: created successfully Jul 09 17:07:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-daebf724-81a2-46a7-b43f-3066b877ddf6 tempest-GroupsV320Test-1920773184 None] Create group completed successfully. Jul 09 17:07:53 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a3c3516-48e4-487a-bc90-994d6650c055" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-3a3c3516-48e4-487a-bc90-994d6650c055" released by "delete_volume" :: held 1.541s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Created reservations ['ff5c3653-3e0e-42b8-8b19-32c6a2512165', '379bec6a-b6d5-40c8-aa7a-e65f84009f88', '802dd3bb-6b02-43fa-a10e-13f3016c3990', '48e81733-8227-4fda-9fed-25425c0192c1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:53 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:53 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-9fa91bd2-00c4-4c78-8dad-545d2ee6a899-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "cinder-9fa91bd2-00c4-4c78-8dad-545d2ee6a899-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-quobyte-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fe1a4-9ebc-4eee-8378-4665cce32b59]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:54 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.064s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Deleted volume successfully. Jul 09 17:07:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e253494f-74ff-47ab-9e00-26eeac078e7e tempest-VolumesListTestJSON-716100022 None] Lock "cinder-3a3c3516-48e4-487a-bc90-994d6650c055-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:54 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 Jul 09 17:07:54 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Created reservations ['d09b1046-a4f1-43aa-89e6-bae8df4b12d2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:55 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:55 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:55 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" returned: 0 in 1.056s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:55 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899 Jul 09 17:07:55 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:56 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.221s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:56 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-62872e80-2e17-463a-b9f4-4eee3fb25546 tempest-GroupsV320Test-1920773184 None] Delete group completed successfully. Jul 09 17:07:57 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" returned: 0 in 1.469s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-9fa91bd2-00c4-4c78-8dad-545d2ee6a899" released by "delete_volume" :: held 2.592s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Created reservations ['70478367-ffa0-45ab-b6b1-03fd0062cd3e', '8afef7c6-1c70-4156-a520-f6c6a31664e5', '401b8c2d-da14-4684-866b-80144312d650', 'a9c4f70f-d3e0-4abf-a814-30606c305f9d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:07:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:57 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:07:57 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-6f609b42-87ef-47cc-8ac5-c18107c007aa-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "cinder-6f609b42-87ef-47cc-8ac5-c18107c007aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Acquiring lock "cinder-quobyte-6f609b42-87ef-47cc-8ac5-c18107c007aa" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-6f609b42-87ef-47cc-8ac5-c18107c007aa" acquired by "delete_volume" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daef92f-ea3f-46d8-ac9e-98e2bc6046f2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:58 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa Jul 09 17:07:58 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:07:58 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.064s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:07:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Deleted volume successfully. Jul 09 17:07:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af253ad2-6215-46b2-869b-da9167c73d32 tempest-VolumesListTestJSON-716100022 None] Lock "cinder-9fa91bd2-00c4-4c78-8dad-545d2ee6a899-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:07:59 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 09 17:07:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa" returned: 0 in 1.152s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:07:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:07:59 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa Jul 09 17:07:59 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:00 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f609b42-87ef-47cc-8ac5-c18107c007aa" returned: 0 in 0.864s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "cinder-quobyte-6f609b42-87ef-47cc-8ac5-c18107c007aa" released by "delete_volume" :: held 2.083s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Created reservations ['36682a39-0c36-4368-8106-782dee6c429c', '5998e67f-ec31-46a6-ae2a-aa901d54bf4b', 'e6641cf2-51eb-406b-9b55-0aadc5a733a5', 'd386a322-925b-47f4-9a9d-5b412c416f6e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:00 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:08:00 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:00 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:08:00 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:01 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.964s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:08:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Deleted volume successfully. Jul 09 17:08:01 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aba53af4-6369-41b0-a018-ba3f1756c94a tempest-VolumesListTestJSON-716100022 None] Lock "cinder-6f609b42-87ef-47cc-8ac5-c18107c007aa-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.943s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:08:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:08:10 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=62,cinder:SELECT=46,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:08:11 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=59,cinder:SELECT=43,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Flow 'volume_create_manager' (d0b1ff8f-42ec-4a3a-8115-9789bae11ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913b530-2abb-41cc-85d1-1e1972562150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913b530-2abb-41cc-85d1-1e1972562150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1927652381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d8e6d4-5c01-4e8a-9504-39860a18a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0086f3e0868b47309b6f689bb95c44f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:18Z,use_quota=True,user_id='67e4d298f0984bf0ba09ab1b059e4ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016b039d-c461-4856-9927-3d0f59d1588f),volume_type_id=016b039d-c461-4856-9927-3d0f59d1588f)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe7e76-6ef8-467d-9315-902d3a6ee35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe7e76-6ef8-467d-9315-902d3a6ee35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4ce2-ab79-497f-84b1-4780d9139a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4ce2-ab79-497f-84b1-4780d9139a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d8e6d4-5c01-4e8a-9504-39860a18a484', 'volume_name': 'volume-42d8e6d4-5c01-4e8a-9504-39860a18a484', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c263b218-7e63-48c9-8889-faccfb134534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c263b218-7e63-48c9-8889-faccfb134534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8b2e0c-b3b3-464f-ad06-a6d924a38930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Volume 42d8e6d4-5c01-4e8a-9504-39860a18a484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d8e6d4-5c01-4e8a-9504-39860a18a484', 'volume_size': 1} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1927652381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d8e6d4-5c01-4e8a-9504-39860a18a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0086f3e0868b47309b6f689bb95c44f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:18Z,use_quota=True,user_id='67e4d298f0984bf0ba09ab1b059e4ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016b039d-c461-4856-9927-3d0f59d1588f),volume_type_id=016b039d-c461-4856-9927-3d0f59d1588f)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Creating volume 42d8e6d4-5c01-4e8a-9504-39860a18a484 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:08:18 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:08:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:18 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 1073741824 Jul 09 17:08:18 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:20 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 1073741824" returned: 0 in 1.479s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:20 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 Jul 09 17:08:20 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:21 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484" returned: 0 in 1.044s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] <== create_volume: return (2637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8b2e0c-b3b3-464f-ad06-a6d924a38930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d8e6d4-5c01-4e8a-9504-39860a18a484', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14142600-94a1-4232-b894-f55a635baa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Volume volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 (42d8e6d4-5c01-4e8a-9504-39860a18a484): created successfully Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14142600-94a1-4232-b894-f55a635baa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Flow 'volume_create_manager' (d0b1ff8f-42ec-4a3a-8115-9789bae11ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a94df81f-5413-4b05-b6bc-1603bd435ff0 tempest-VolumeTypesAccessTest-2051567658 None] Created volume successfully. Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Acquiring lock "cinder-42d8e6d4-5c01-4e8a-9504-39860a18a484-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "cinder-42d8e6d4-5c01-4e8a-9504-39860a18a484-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Acquiring lock "cinder-quobyte-42d8e6d4-5c01-4e8a-9504-39860a18a484" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "cinder-quobyte-42d8e6d4-5c01-4e8a-9504-39860a18a484" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe61213-bb3f-44d7-92b9-0ee407d5a4b9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:08:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:22 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 Jul 09 17:08:22 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:23 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484" returned: 0 in 1.234s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:23 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484 Jul 09 17:08:23 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:24 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-42d8e6d4-5c01-4e8a-9504-39860a18a484" returned: 0 in 1.013s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "cinder-quobyte-42d8e6d4-5c01-4e8a-9504-39860a18a484" released by "delete_volume" :: held 2.325s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:24 devstack cinder-volume[86876]: WARNING cinder.quota [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1106575747 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1106575747, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:08:24 devstack cinder-volume[86876]: WARNING cinder.quota [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1106575747 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1106575747, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Created reservations ['b6e2392f-6a3f-48a5-96d2-de115ae0f1b5', '33acb22d-1f7d-4195-a9b2-0e2271dce962', 'c8082a2f-f64e-46fb-ba48-7d0e9a23a7f7', 'e5926e0f-0bd9-462d-b467-7d63e940533d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:24 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:08:24 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:25 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.956s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:25 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:08:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Deleted volume successfully. Jul 09 17:08:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2b33fc87-9e93-4255-8f91-5b13c96d852b tempest-VolumeTypesAccessTest-2051567658 None] Lock "cinder-42d8e6d4-5c01-4e8a-9504-39860a18a484-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Flow 'volume_create_manager' (58dcf8eb-737e-4391-85ac-6bcc5d4a057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a899503c-2809-42bf-808c-b80d7d0705b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a899503c-2809-42bf-808c-b80d7d0705b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1802829194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1052b91-f054-4dcd-a3c9-32ababe0ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868c4c1aae884dc7b7efb1d7b19359c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:28Z,use_quota=True,user_id='f13bf479a14540c388a9c187efe70150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329fd3d-3bb6-4ad2-8d1e-3d13dcebd835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329fd3d-3bb6-4ad2-8d1e-3d13dcebd835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d63e939-0bf7-449c-950f-2a1ea773d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d63e939-0bf7-449c-950f-2a1ea773d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1052b91-f054-4dcd-a3c9-32ababe0ed1b', 'volume_name': 'volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df11faa0-11ce-465d-9edd-8f4d24679516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df11faa0-11ce-465d-9edd-8f4d24679516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d31a12f-c51e-4906-8cf6-7938acb865ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Volume d1052b91-f054-4dcd-a3c9-32ababe0ed1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b', 'volume_size': 1} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1802829194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1052b91-f054-4dcd-a3c9-32ababe0ed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868c4c1aae884dc7b7efb1d7b19359c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:28Z,use_quota=True,user_id='f13bf479a14540c388a9c187efe70150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Creating volume d1052b91-f054-4dcd-a3c9-32ababe0ed1b {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:08:28 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:08:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:28 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b 1073741824 Jul 09 17:08:28 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:30 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b 1073741824" returned: 0 in 1.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:30 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b Jul 09 17:08:30 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:31 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" returned: 0 in 1.231s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] <== create_volume: return (3193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.197s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d31a12f-c51e-4906-8cf6-7938acb865ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b6b63b-4285-4abf-8abc-2a7d64a0530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Volume volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b (d1052b91-f054-4dcd-a3c9-32ababe0ed1b): created successfully Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b6b63b-4285-4abf-8abc-2a7d64a0530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Flow 'volume_create_manager' (58dcf8eb-737e-4391-85ac-6bcc5d4a057a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c8aeca22-382f-4f6a-b41b-ea5773b8ee84 tempest-ServerRescueNegativeTestJSON-934358919 None] Created volume successfully. Jul 09 17:08:41 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:08:41 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Acquiring lock "cinder-d1052b91-f054-4dcd-a3c9-32ababe0ed1b-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "cinder-d1052b91-f054-4dcd-a3c9-32ababe0ed1b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Acquiring lock "cinder-quobyte-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "cinder-quobyte-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256a5bf-6516-455e-9b14-2a228b7e2c3b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:08:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:53 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b Jul 09 17:08:53 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:54 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" returned: 0 in 0.995s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:54 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b Jul 09 17:08:54 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Flow 'volume_create_manager' (775deded-6b86-41a0-a730-9c90cb5e8e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f3b656-e4fe-45cc-b2ee-f4bb8552dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f3b656-e4fe-45cc-b2ee-f4bb8552dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1912801632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa406ccd-66f7-4f8b-a481-e8569421c937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05059bbd9eaf4888830503ebd4f68982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:55Z,use_quota=True,user_id='550d614817b74af79aa1c956e6184220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc6ed7-abc9-47b4-b627-2f0e2d0f5a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc6ed7-abc9-47b4-b627-2f0e2d0f5a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3feea-ab72-47f0-b05e-12e90c147546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3feea-ab72-47f0-b05e-12e90c147546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa406ccd-66f7-4f8b-a481-e8569421c937', 'volume_name': 'volume-fa406ccd-66f7-4f8b-a481-e8569421c937', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d492d6f-cce0-411a-a47b-8644b31a6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d492d6f-cce0-411a-a47b-8644b31a6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ff13ca-89f8-43f6-a321-179ec54aae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Volume fa406ccd-66f7-4f8b-a481-e8569421c937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa406ccd-66f7-4f8b-a481-e8569421c937', 'volume_size': 1} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1912801632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa406ccd-66f7-4f8b-a481-e8569421c937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05059bbd9eaf4888830503ebd4f68982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:08:55Z,use_quota=True,user_id='550d614817b74af79aa1c956e6184220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Creating volume fa406ccd-66f7-4f8b-a481-e8569421c937 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:08:55 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:55 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 1073741824 Jul 09 17:08:55 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:55 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" returned: 0 in 1.081s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "cinder-quobyte-d1052b91-f054-4dcd-a3c9-32ababe0ed1b" released by "delete_volume" :: held 2.166s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Created reservations ['40b15098-5f45-46cb-bb5e-20b9b4656dfa', '76b99046-ed4a-400b-997a-d2b06dc80d3a', 'eb6b1c4d-fea7-440c-b7a3-301bea4bdeaa', 'c4883abb-19f8-4b03-a112-0284cd62096e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:56 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:08:56 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:56 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 1073741824" returned: 0 in 1.109s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:08:56 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 Jul 09 17:08:56 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:08:57 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.966s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:08:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Deleted volume successfully. Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-69aa7a44-1e42-4973-80e4-04a48e06379f tempest-ServerRescueNegativeTestJSON-934358919 None] Lock "cinder-d1052b91-f054-4dcd-a3c9-32ababe0ed1b-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:08:57 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937" returned: 0 in 1.168s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] <== create_volume: return (2370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:08:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.376s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:08:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ff13ca-89f8-43f6-a321-179ec54aae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa406ccd-66f7-4f8b-a481-e8569421c937', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f9a6d6-53f0-4bb2-8112-eb016d1064da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:08:58 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Volume volume-fa406ccd-66f7-4f8b-a481-e8569421c937 (fa406ccd-66f7-4f8b-a481-e8569421c937): created successfully Jul 09 17:08:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f9a6d6-53f0-4bb2-8112-eb016d1064da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:08:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Flow 'volume_create_manager' (775deded-6b86-41a0-a730-9c90cb5e8e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:08:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ee8fb610-9fc1-4c1f-ace0-4f0aee1ffec4 tempest-VolumesTransfersTest-233176626 None] Created volume successfully. Jul 09 17:08:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c1e4c0be-6ff2-4987-8f2f-d0948b29d826 tempest-VolumesTransfersTest-1512683808 None] Transfer volume completed successfully. Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:00 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:00 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "cinder-fa406ccd-66f7-4f8b-a481-e8569421c937-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-fa406ccd-66f7-4f8b-a481-e8569421c937-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "cinder-quobyte-fa406ccd-66f7-4f8b-a481-e8569421c937" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-quobyte-fa406ccd-66f7-4f8b-a481-e8569421c937" acquired by "delete_volume" :: waited 0.048s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[39069e0f-146d-4561-8672-96c36b042226]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:01 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.410s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:09:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:09:01 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 Jul 09 17:09:01 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:02 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937" returned: 0 in 1.207s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:03 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937 Jul 09 17:09:03 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (fb2a4386-8373-49a9-8fb9-6d3f8c2040a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e54da8a-ba6f-4795-b74f-a10f84f25fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e54da8a-ba6f-4795-b74f-a10f84f25fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-406334182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f99a912-514f-4e58-b50d-ff4298dc4335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:04Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c352ba42-05a2-47f1-9982-aa8a37032b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c352ba42-05a2-47f1-9982-aa8a37032b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f189fa-dd86-4ee8-998e-5539d950fd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f189fa-dd86-4ee8-998e-5539d950fd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f99a912-514f-4e58-b50d-ff4298dc4335', 'volume_name': 'volume-6f99a912-514f-4e58-b50d-ff4298dc4335', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015effa0-26d1-4916-84e7-0bcd791bec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015effa0-26d1-4916-84e7-0bcd791bec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88c9bab-7817-4e55-a08e-cacab4753453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Volume 6f99a912-514f-4e58-b50d-ff4298dc4335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f99a912-514f-4e58-b50d-ff4298dc4335', 'volume_size': 1} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-406334182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f99a912-514f-4e58-b50d-ff4298dc4335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:04Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Creating volume 6f99a912-514f-4e58-b50d-ff4298dc4335 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:03 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:03 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 1073741824 Jul 09 17:09:03 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:04 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fa406ccd-66f7-4f8b-a481-e8569421c937" returned: 0 in 1.222s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-quobyte-fa406ccd-66f7-4f8b-a481-e8569421c937" released by "delete_volume" :: held 2.512s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Created reservations ['ed46a189-4f98-4226-9041-2cb5192f9424', 'aa66bb41-1825-499e-9d5c-10aacd386b0d', '52ec7f35-4077-44d3-9a6a-7aca02b667ab', '22e2d47f-c232-433a-99c5-984f0f365240'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:04 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:04 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:05 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 1073741824" returned: 0 in 1.609s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:05 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 Jul 09 17:09:05 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:06 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Deleted volume successfully. Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6de7bff1-ec69-40df-99d0-8d44826cfc10 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-fa406ccd-66f7-4f8b-a481-e8569421c937-delete_volume" released by "delete_volume" :: held 4.620s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Flow 'volume_create_manager' (dbec5528-4ef1-453b-9056-7370c065f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c07dda3-e430-4a63-96f3-35d6e6de3cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c07dda3-e430-4a63-96f3-35d6e6de3cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1115492611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3707d1-9b64-4bb2-b7b2-e082663489e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05059bbd9eaf4888830503ebd4f68982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:06Z,use_quota=True,user_id='550d614817b74af79aa1c956e6184220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7756d33e-f428-4659-b624-acb502d7a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7756d33e-f428-4659-b624-acb502d7a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6843382-7849-4b4e-af23-90d714fe8a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6843382-7849-4b4e-af23-90d714fe8a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3707d1-9b64-4bb2-b7b2-e082663489e5', 'volume_name': 'volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa549e21-fe03-4611-8cff-31ac1ff520bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa549e21-fe03-4611-8cff-31ac1ff520bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a5dfa3-0700-463e-9f0c-01bc7e10da58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Volume 8e3707d1-9b64-4bb2-b7b2-e082663489e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5', 'volume_size': 1} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:06 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335" returned: 0 in 1.082s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] <== create_volume: return (2804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.807s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1115492611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3707d1-9b64-4bb2-b7b2-e082663489e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05059bbd9eaf4888830503ebd4f68982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:06Z,use_quota=True,user_id='550d614817b74af79aa1c956e6184220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Creating volume 8e3707d1-9b64-4bb2-b7b2-e082663489e5 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:06 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88c9bab-7817-4e55-a08e-cacab4753453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f99a912-514f-4e58-b50d-ff4298dc4335', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 1073741824 Jul 09 17:09:06 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4df166-de53-4727-a189-7b3199672e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:06 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Volume volume-6f99a912-514f-4e58-b50d-ff4298dc4335 (6f99a912-514f-4e58-b50d-ff4298dc4335): created successfully Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4df166-de53-4727-a189-7b3199672e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (fb2a4386-8373-49a9-8fb9-6d3f8c2040a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-64d428f1-3aa2-4cdd-9bef-957e28cf0a29 tempest-AttachVolumeTestJSON-1403084940 None] Created volume successfully. Jul 09 17:09:07 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 1073741824" returned: 0 in 1.192s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:07 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 Jul 09 17:09:07 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:08 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5" returned: 0 in 0.878s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a5dfa3-0700-463e-9f0c-01bc7e10da58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009724bf-13be-4cb7-80b3-c75c88dd1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:08 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Volume volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 (8e3707d1-9b64-4bb2-b7b2-e082663489e5): created successfully Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009724bf-13be-4cb7-80b3-c75c88dd1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Flow 'volume_create_manager' (dbec5528-4ef1-453b-9056-7370c065f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c6a11cca-bc9e-4ec4-aba8-26d5240146e8 tempest-VolumesTransfersTest-233176626 None] Created volume successfully. Jul 09 17:09:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "cinder-8e3707d1-9b64-4bb2-b7b2-e082663489e5-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-8e3707d1-9b64-4bb2-b7b2-e082663489e5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "cinder-quobyte-8e3707d1-9b64-4bb2-b7b2-e082663489e5" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-quobyte-8e3707d1-9b64-4bb2-b7b2-e082663489e5" acquired by "delete_volume" :: waited 0.033s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4824f-f287-4a58-80f4-be2646dead97]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:10 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 Jul 09 17:09:10 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c49da0-7ddb-4618-adae-c947887419a3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:10 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 Jul 09 17:09:10 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:11 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5" returned: 0 in 1.281s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:11 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5 Jul 09 17:09:11 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:11 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335" returned: 0 in 0.984s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-6f99a912-514f-4e58-b50d-ff4298dc4335', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc0137dd-72f0-4c8a-83ca-4a6a1ea01c6f', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:09:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-3fcc38b5-cbfc-4a47-b547-34fde6bfcb61 req-3e644bdb-919a-4250-ab7f-db0056d39cf9 tempest-AttachVolumeTestJSON-1403084940 None] attachment_update completed successfully. Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Flow 'volume_create_manager' (70c113d9-3fc1-406b-b37b-0d68406231d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf03000-8bd5-47f3-bbbc-acf51ab75f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:12 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e3707d1-9b64-4bb2-b7b2-e082663489e5" returned: 0 in 0.862s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf03000-8bd5-47f3-bbbc-acf51ab75f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1300227794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c7ffab-53b0-4ce6-a93d-77027a80e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209f138724f4408a8d082f371eae9c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:12Z,use_quota=True,user_id='a64a54ed2bb44131ae461796f2ca568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9480cec-d251-4002-8219-2ed6b752fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9480cec-d251-4002-8219-2ed6b752fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76abc8e0-a3a4-40e6-8630-3e831d728c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76abc8e0-a3a4-40e6-8630-3e831d728c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c7ffab-53b0-4ce6-a93d-77027a80e75f', 'volume_name': 'volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c09b0f-6260-4b02-8634-7f8ffff3b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c09b0f-6260-4b02-8634-7f8ffff3b656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd51b4e8-82b5-4c07-a1d2-be2bdd83cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Volume 07c7ffab-53b0-4ce6-a93d-77027a80e75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f', 'volume_size': 1} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1300227794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c7ffab-53b0-4ce6-a93d-77027a80e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209f138724f4408a8d082f371eae9c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:12Z,use_quota=True,user_id='a64a54ed2bb44131ae461796f2ca568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Creating volume 07c7ffab-53b0-4ce6-a93d-77027a80e75f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-quobyte-8e3707d1-9b64-4bb2-b7b2-e082663489e5" released by "delete_volume" :: held 2.350s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:12 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f 1073741824 Jul 09 17:09:12 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Created reservations ['7f9adfeb-61c4-447d-9ffa-bc49107a702c', '74164449-5ffb-484a-8ace-f263b0229cb8', '80031c0d-c8a2-4032-9825-1039a0603ff7', 'c97839df-ba64-4747-a101-92040014332f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:12 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:12 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:13 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f 1073741824" returned: 0 in 1.110s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:13 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f Jul 09 17:09:13 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:13 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.090s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:13 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Deleted volume successfully. Jul 09 17:09:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e8d9651-2c69-4933-bdfe-4c3d5eb3e8c9 tempest-VolumesTransfersTest-50614976 None] Lock "cinder-8e3707d1-9b64-4bb2-b7b2-e082663489e5-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:14 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f" returned: 0 in 1.078s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd51b4e8-82b5-4c07-a1d2-be2bdd83cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa7730c-2bee-4b93-a6be-85b6a0bd4651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Volume volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f (07c7ffab-53b0-4ce6-a93d-77027a80e75f): created successfully Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa7730c-2bee-4b93-a6be-85b6a0bd4651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Flow 'volume_create_manager' (70c113d9-3fc1-406b-b37b-0d68406231d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3507ee36-e6c2-45ad-82de-8aeb7668521b tempest-TestMinimumBasicScenario-1303985952 None] Created volume successfully. Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (bf2be372-fb02-4ae7-ba48-567df4a78276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6734a3db-8e5d-4595-8be6-3d38a089bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6734a3db-8e5d-4595-8be6-3d38a089bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2140811394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:18Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6c0efa-0626-48da-b5ed-f954ad6f36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6c0efa-0626-48da-b5ed-f954ad6f36e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a70a8a6-b31e-430a-8a8c-0cd48dbd26bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a70a8a6-b31e-430a-8a8c-0cd48dbd26bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9', 'volume_name': 'volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848e1b34-e011-44cd-a002-769d0f62e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848e1b34-e011-44cd-a002-769d0f62e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5ee7fb-77d6-496c-8c18-b6e0dbf903f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Volume 8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9', 'volume_size': 1} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2140811394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda94f7aab6b4e64ab56d5e8d1431ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:18Z,use_quota=True,user_id='87f60dcbc3cc4fdba7bd921d62d38a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Creating volume 8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:18 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:18 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 1073741824 Jul 09 17:09:18 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:19 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 1073741824" returned: 0 in 1.593s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:19 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 Jul 09 17:09:19 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:20 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" returned: 0 in 1.086s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] <== create_volume: return (2827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.835s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.580s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5ee7fb-77d6-496c-8c18-b6e0dbf903f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae156e2-37b5-40c7-bd16-d9f8271a2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[68305c78-1aa9-41ed-97c3-7b0de2a28a50]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:20 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Volume volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 (8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9): created successfully Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae156e2-37b5-40c7-bd16-d9f8271a2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Flow 'volume_create_manager' (bf2be372-fb02-4ae7-ba48-567df4a78276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c8e831b0-2dd1-4ca0-a8ff-204d17038a90 tempest-AttachVolumeTestJSON-1403084940 None] Created volume successfully. Jul 09 17:09:21 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f Jul 09 17:09:21 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:21 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f" returned: 0 in 0.918s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9893c6dc-cd0e-490b-ad26-0f17d8e311e2', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:09:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-44fb85d6-7769-4532-b89f-d0b6a49662c9 req-64e16a0e-c0c0-4a08-9179-c379e42624f0 tempest-TestMinimumBasicScenario-1303985952 None] attachment_update completed successfully. Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Flow 'volume_create_manager' (102678f0-53f4-4f8e-8dd6-c64c5f8e6de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea7ad12-f7b7-451d-823d-7bb9ea584552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea7ad12-f7b7-451d-823d-7bb9ea584552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-860275633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a087e62c-5389-439f-95a6-5d2f08e6dce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ec87301c6c49908a99d1647814355c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:24Z,use_quota=True,user_id='db345b3287194fbca1d77bdc7ab24372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a0b3e0-978d-40e5-9967-43c9199e6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a0b3e0-978d-40e5-9967-43c9199e6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07a7f5-86be-47b5-b88c-1795204ccdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07a7f5-86be-47b5-b88c-1795204ccdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a087e62c-5389-439f-95a6-5d2f08e6dce9', 'volume_name': 'volume-a087e62c-5389-439f-95a6-5d2f08e6dce9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192314fe-839d-49b9-a4be-b23b84be85fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192314fe-839d-49b9-a4be-b23b84be85fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb75dc5-7106-40bc-bc3b-d12c76fc3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Volume a087e62c-5389-439f-95a6-5d2f08e6dce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a087e62c-5389-439f-95a6-5d2f08e6dce9', 'volume_size': 1} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-860275633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a087e62c-5389-439f-95a6-5d2f08e6dce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ec87301c6c49908a99d1647814355c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:24Z,use_quota=True,user_id='db345b3287194fbca1d77bdc7ab24372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Creating volume a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:23 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:23 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 1073741824 Jul 09 17:09:23 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Flow 'volume_create_manager' (7cfee648-c2ef-40fe-81a4-a11dc9dd7a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b9a683-f3f5-4d68-b9ab-3ffa0d6fc628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b9a683-f3f5-4d68-b9ab-3ffa0d6fc628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-575529606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8c0638-3771-46f4-ab8a-298a691883e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fde871c9b147129d598cc0ae2625a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:24Z,use_quota=True,user_id='428495f8a3b94431b08be39623a249c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b7785a-c5e1-45d7-8cb5-5fee9527df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b7785a-c5e1-45d7-8cb5-5fee9527df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057bd19-4f7c-43b3-bda7-44c1a68be427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c057bd19-4f7c-43b3-bda7-44c1a68be427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8c0638-3771-46f4-ab8a-298a691883e6', 'volume_name': 'volume-aa8c0638-3771-46f4-ab8a-298a691883e6', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94099b3c-4cf1-468f-a4d2-a76f6dc666b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94099b3c-4cf1-468f-a4d2-a76f6dc666b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c54bff9-f72d-4a82-ae35-a01eb42392ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Volume aa8c0638-3771-46f4-ab8a-298a691883e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8c0638-3771-46f4-ab8a-298a691883e6', 'volume_size': 1} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:24 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 1073741824" returned: 0 in 0.933s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:24 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 Jul 09 17:09:24 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:25 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-575529606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8c0638-3771-46f4-ab8a-298a691883e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fde871c9b147129d598cc0ae2625a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:24Z,use_quota=True,user_id='428495f8a3b94431b08be39623a249c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Creating volume aa8c0638-3771-46f4-ab8a-298a691883e6 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:25 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb75dc5-7106-40bc-bc3b-d12c76fc3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a087e62c-5389-439f-95a6-5d2f08e6dce9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:25 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 1073741824 Jul 09 17:09:25 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbb2127-613b-4618-b76a-cdc400979e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:25 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Volume volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 (a087e62c-5389-439f-95a6-5d2f08e6dce9): created successfully Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbb2127-613b-4618-b76a-cdc400979e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Flow 'volume_create_manager' (102678f0-53f4-4f8e-8dd6-c64c5f8e6de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-d5f25c5f-65ae-411c-99b1-217ff860abe1 req-8092fff9-3daa-4c76-9a31-9c02bef9c188 tempest-VolumesSnapshotsTestJSON-1133868338 None] Created volume successfully. Jul 09 17:09:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:26 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 1073741824" returned: 0 in 0.920s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:26 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 Jul 09 17:09:26 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:27 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.769s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c54bff9-f72d-4a82-ae35-a01eb42392ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8c0638-3771-46f4-ab8a-298a691883e6', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a33d62-ab4a-4ffe-8fae-e7a38d073396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ced7dd-ffae-4fd5-be9c-293bc727e2fa]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Volume volume-aa8c0638-3771-46f4-ab8a-298a691883e6 (aa8c0638-3771-46f4-ab8a-298a691883e6): created successfully Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a33d62-ab4a-4ffe-8fae-e7a38d073396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Flow 'volume_create_manager' (7cfee648-c2ef-40fe-81a4-a11dc9dd7a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f9b7aa96-7190-43cf-838b-c1671b1d9322 tempest-VolumesTransfersV357Test-1627135102 None] Created volume successfully. Jul 09 17:09:27 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 Jul 09 17:09:27 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:28 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" returned: 0 in 1.056s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.195s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Creating offline snapshot 0ac3a183-c426-477f-926e-084cc6b739e2 of volume a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d1344-87b7-4574-b520-f537d3d15715]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9fe9bc0-69a4-46fb-9a96-c869b192829b', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:09:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b2eda062-dd6b-479e-bb5d-93fb81b4c351 tempest-VolumesTransfersV357Test-1728304003 None] Transfer volume completed successfully. Jul 09 17:09:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-14e169f5-727d-4ebf-b99f-e21f99749370 req-07791d6a-b3f3-4579-8655-2a1ee1fdfcbd tempest-AttachVolumeTestJSON-1403084940 None] attachment_update completed successfully. Jul 09 17:09:28 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 Jul 09 17:09:28 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:29 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9" returned: 0 in 1.064s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:29 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 1G Jul 09 17:09:29 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "cinder-aa8c0638-3771-46f4-ab8a-298a691883e6-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-aa8c0638-3771-46f4-ab8a-298a691883e6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "cinder-quobyte-aa8c0638-3771-46f4-ab8a-298a691883e6" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-quobyte-aa8c0638-3771-46f4-ab8a-298a691883e6" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[423ae390-bc0e-44b0-a7f2-61144f9a5541]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:29 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 Jul 09 17:09:29 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:30 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 1G" returned: 0 in 1.029s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:30 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 Jul 09 17:09:30 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:30 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6" returned: 0 in 0.862s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:30 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6 Jul 09 17:09:30 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:31 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2" returned: 0 in 0.996s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:31 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 is being set with open permissions: ugo+rw Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:31 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 Jul 09 17:09:31 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:31 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa8c0638-3771-46f4-ab8a-298a691883e6" returned: 0 in 0.799s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-quobyte-aa8c0638-3771-46f4-ab8a-298a691883e6" released by "delete_volume" :: held 1.717s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Created reservations ['c59745d6-a138-4495-8c45-6a437cff2531', 'a7bb1527-10b0-4f12-9f4a-47db73237cee', '2da114ac-bf1f-4de8-b263-6b89cd371444', 'bbbac7f6-243c-4eb7-a44b-5fcf01182cc6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:31 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:31 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:32 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2" returned: 0 in 0.729s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:32 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info Jul 09 17:09:32 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:32 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.991s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Deleted volume successfully. Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0dadd731-f737-47f9-8b7f-7946b7c7a6d5 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-aa8c0638-3771-46f4-ab8a-298a691883e6-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Flow 'volume_create_manager' (d5aae631-2dab-46d1-887d-f1a0953cbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c34ff9-ca62-4e1b-8ff7-4b8acb5b1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c34ff9-ca62-4e1b-8ff7-4b8acb5b1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-300757107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43daee5-83bc-49f0-b55d-da950692335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fde871c9b147129d598cc0ae2625a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:33Z,use_quota=True,user_id='428495f8a3b94431b08be39623a249c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15823e6-fbd8-4537-b315-80870caa155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15823e6-fbd8-4537-b315-80870caa155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d5fbbe-c689-4835-a1ab-2b2c99ecf381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d5fbbe-c689-4835-a1ab-2b2c99ecf381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43daee5-83bc-49f0-b55d-da950692335c', 'volume_name': 'volume-a43daee5-83bc-49f0-b55d-da950692335c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa64970-17fa-47db-aec2-8b04e413eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa64970-17fa-47db-aec2-8b04e413eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55992c46-fa50-4667-9bc8-72bf1bc728cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:32 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Volume a43daee5-83bc-49f0-b55d-da950692335c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43daee5-83bc-49f0-b55d-da950692335c', 'volume_size': 1} Jul 09 17:09:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:33 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info" returned: 0 in 0.932s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:33 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info is being set with open permissions: ugo+rw Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:33 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info Jul 09 17:09:33 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:33 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.info" returned: 0 in 0.746s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.631s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-300757107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43daee5-83bc-49f0-b55d-da950692335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30fde871c9b147129d598cc0ae2625a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:33Z,use_quota=True,user_id='428495f8a3b94431b08be39623a249c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Creating volume a43daee5-83bc-49f0-b55d-da950692335c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:33 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c 1073741824 Jul 09 17:09:33 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-04110785-01b8-4962-81ad-7a89a3790dea req-2a069473-178a-4da9-beaa-53f5ceb466d9 tempest-VolumesSnapshotsTestJSON-1133868338 None] Create snapshot completed successfully Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "cinder-0ac3a183-c426-477f-926e-084cc6b739e2-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-0ac3a183-c426-477f-926e-084cc6b739e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "cinder-quobyte-0ac3a183-c426-477f-926e-084cc6b739e2" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-0ac3a183-c426-477f-926e-084cc6b739e2" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Deleting offline snapshot 0ac3a183-c426-477f-926e-084cc6b739e2 of volume a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] snapshot_file for this snap is: volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732d4d5-562c-460a-bb69-c0125bd377ff]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:34 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 Jul 09 17:09:34 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:34 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c 1073741824" returned: 0 in 1.059s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:35 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c Jul 09 17:09:35 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-c69bd73d-1a46-42e8-938b-9287bd1e3f7e req-dfc432e2-e662-48c9-b050-9245163f8786 tempest-AttachVolumeTestJSON-1403084940 None] Terminate volume connection completed successfully. Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-c69bd73d-1a46-42e8-938b-9287bd1e3f7e req-dfc432e2-e662-48c9-b050-9245163f8786 tempest-AttachVolumeTestJSON-1403084940 None] Deleting attachment cc0137dd-72f0-4c8a-83ca-4a6a1ea01c6f. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:09:35 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2" returned: 0 in 0.842s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a087e62c-5389-439f-95a6-5d2f08e6dce9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb56a5a-409a-4029-ba7b-c684207739c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:35 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c" returned: 0 in 0.690s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55992c46-fa50-4667-9bc8-72bf1bc728cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43daee5-83bc-49f0-b55d-da950692335c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f63600a-7c3b-4c0c-a84f-34f2fa7fe5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:35 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 Jul 09 17:09:35 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Volume volume-a43daee5-83bc-49f0-b55d-da950692335c (a43daee5-83bc-49f0-b55d-da950692335c): created successfully Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f63600a-7c3b-4c0c-a84f-34f2fa7fe5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Flow 'volume_create_manager' (d5aae631-2dab-46d1-887d-f1a0953cbd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2d538c85-7d0a-49d1-b9c1-510e76dc8e06 tempest-VolumesTransfersV357Test-1627135102 None] Created volume successfully. Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "cinder-a43daee5-83bc-49f0-b55d-da950692335c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-a43daee5-83bc-49f0-b55d-da950692335c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "cinder-quobyte-a43daee5-83bc-49f0-b55d-da950692335c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-quobyte-a43daee5-83bc-49f0-b55d-da950692335c" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d2819e-de49-45b5-b02f-fe54740cee7f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:36 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c Jul 09 17:09:36 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:36 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9" returned: 0 in 0.916s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:36 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 Jul 09 17:09:36 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:37 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c" returned: 0 in 0.882s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:37 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c Jul 09 17:09:37 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:37 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2" returned: 0 in 0.838s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:37 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2 Jul 09 17:09:37 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-79adc853-052c-43c0-bad0-2d40a52f7fc9 req-634cc456-77d6-46b2-b937-d88a0408fdf7 tempest-AttachVolumeTestJSON-1403084940 None] Terminate volume connection completed successfully. Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-79adc853-052c-43c0-bad0-2d40a52f7fc9 req-634cc456-77d6-46b2-b937-d88a0408fdf7 tempest-AttachVolumeTestJSON-1403084940 None] Deleting attachment d9fe9bc0-69a4-46fb-9a96-c869b192829b. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:09:38 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a43daee5-83bc-49f0-b55d-da950692335c" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-quobyte-a43daee5-83bc-49f0-b55d-da950692335c" released by "delete_volume" :: held 1.688s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:38 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9.0ac3a183-c426-477f-926e-084cc6b739e2" returned: 0 in 0.709s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Created reservations ['6d521e38-4009-455c-90ef-7bcf4949bedb', 'dcc7b935-3a49-44d6-826a-c041964d5195', 'b9d161e4-31d0-4223-a155-10ba05bbf9de', 'e6752060-86b4-47b0-8a73-fb0e9995d217'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-0ac3a183-c426-477f-926e-084cc6b739e2" released by "_delete_snapshot" :: held 3.425s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" released by "delete_snapshot" :: held 3.481s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:38 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:38 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.quota [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Created reservations ['8321da18-bba2-41a3-aa9d-d233b7ed68d2', 'e5d08ea0-5cb4-4ff0-8632-276d05a80d5c', '0f4636ab-fa2b-470a-9ea8-9325a2b07f97', '7dcb9696-c86c-4184-8a0c-383d3a4b0510'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Delete snapshot completed successfully. Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-feacb48c-3b60-4190-82cb-ece6c199e841 req-efaeb01f-b35f-4867-aaae-c40bebbb426d tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-0ac3a183-c426-477f-926e-084cc6b739e2-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:38 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Deleted volume successfully. Jul 09 17:09:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d7f1b2cd-63de-4110-adf0-dd3f719c9dd4 tempest-VolumesTransfersV357Test-1489080471 None] Lock "cinder-a43daee5-83bc-49f0-b55d-da950692335c-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "cinder-a087e62c-5389-439f-95a6-5d2f08e6dce9-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-a087e62c-5389-439f-95a6-5d2f08e6dce9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6fe26a-5808-430d-8af3-0fb9affe79e7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:39 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 Jul 09 17:09:39 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:40 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9" returned: 0 in 0.881s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:40 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9 Jul 09 17:09:40 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:40 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a087e62c-5389-439f-95a6-5d2f08e6dce9" returned: 0 in 0.711s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-quobyte-a087e62c-5389-439f-95a6-5d2f08e6dce9" released by "delete_volume" :: held 1.680s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG cinder.quota [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Created reservations ['26aedc8d-82f7-4e36-ada5-20b7b1437088', '7226b2e7-5227-4b60-91c9-06c0181df138', '4ce439b6-eeb3-4f5e-ad03-8113cd0380a1', '214ff7cc-209a-4894-a0cd-fdd2442fab37'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:40 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:40 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:41 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.782s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:41 devstack cinder-volume[86876]: DEBUG cinder.manager [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Deleted volume successfully. Jul 09 17:09:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-34885e1e-fe80-4748-a259-74d850fd8129 req-d1e5a719-30d1-4e77-8908-a9410d6aed9c tempest-VolumesSnapshotsTestJSON-1133868338 None] Lock "cinder-a087e62c-5389-439f-95a6-5d2f08e6dce9-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-59a1c625-a809-48ef-9ce7-a1fe64279921 tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-415103580: creating Jul 09 17:09:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-59a1c625-a809-48ef-9ce7-a1fe64279921 tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-415103580: created successfully Jul 09 17:09:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-59a1c625-a809-48ef-9ce7-a1fe64279921 tempest-GroupSnapshotsTest-1390286325 None] Create group completed successfully. Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (9496310c-fc62-403d-a864-be6bdadbd5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334ccee7-ccb8-4857-88e0-9a3713cf80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334ccee7-ccb8-4857-88e0-9a3713cf80b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352658375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec4a3c15-e682-4604-acff-d1dc1744f52f,host='devstack@QuobyteHD#QuobyteHD',id=1b56c4d3-ed87-49ea-8e9a-7818b968185e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:49Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ddbf2e4-db0c-4fa2-88d5-71a106276cad),volume_type_id=5ddbf2e4-db0c-4fa2-88d5-71a106276cad)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e3a85-d070-4bf1-a13d-21ab4be3373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e3a85-d070-4bf1-a13d-21ab4be3373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bc334-7f5a-4aa9-951f-ec2490e82dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bc334-7f5a-4aa9-951f-ec2490e82dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b56c4d3-ed87-49ea-8e9a-7818b968185e', 'volume_name': 'volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f6fa6b-b5cc-439b-8cfe-705b857e8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f6fa6b-b5cc-439b-8cfe-705b857e8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de64a8c4-0981-47ae-97f7-bc23f8d033e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:49 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Volume 1b56c4d3-ed87-49ea-8e9a-7818b968185e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e', 'volume_size': 1} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec4a3c15-e682-4604-acff-d1dc1744f52f,created_at=2026-07-09T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352658375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec4a3c15-e682-4604-acff-d1dc1744f52f,host='devstack@QuobyteHD#QuobyteHD',id=1b56c4d3-ed87-49ea-8e9a-7818b968185e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:09:49Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ddbf2e4-db0c-4fa2-88d5-71a106276cad),volume_type_id=5ddbf2e4-db0c-4fa2-88d5-71a106276cad)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Creating volume 1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:09:49 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:09:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:49 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e 1073741824 Jul 09 17:09:49 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:50 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e 1073741824" returned: 0 in 1.091s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:50 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:09:50 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-quobyte-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add4e9c-b739-4900-b10c-f59068edf216]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:50 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 Jul 09 17:09:50 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:51 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 1.099s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de64a8c4-0981-47ae-97f7-bc23f8d033e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b15bfec-8e9d-4b52-bf23-7e16992c6232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:09:51 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Volume volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e (1b56c4d3-ed87-49ea-8e9a-7818b968185e): created successfully Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b15bfec-8e9d-4b52-bf23-7e16992c6232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (9496310c-fc62-403d-a864-be6bdadbd5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:09:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3e84bec5-8bf2-4f85-b810-2b870bad1279 tempest-GroupSnapshotsTest-1390286325 None] Created volume successfully. Jul 09 17:09:51 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" returned: 0 in 1.114s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:51 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9 Jul 09 17:09:51 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:52 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" returned: 0 in 0.703s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9" released by "delete_volume" :: held 1.865s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=84,cinder:INSERT=17,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=77,cinder:SELECT=77,cinder:INSERT=21,cinder:DELETE=11 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Created reservations ['3102b272-cf10-45af-b92d-bfc91c200e66', 'b7727e6a-adf2-4a90-842f-26dec54ccf92', '389eaa38-3756-43d5-848d-618db10c8c6c', 'cf198bbd-4beb-42f9-9b42-472cdf1d2037'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:52 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:52 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-6f99a912-514f-4e58-b50d-ff4298dc4335-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-6f99a912-514f-4e58-b50d-ff4298dc4335-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-quobyte-6f99a912-514f-4e58-b50d-ff4298dc4335" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-6f99a912-514f-4e58-b50d-ff4298dc4335" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a948dc-d9cc-47d7-b791-fbe0eae30736]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] GroupSnapshot 86555655-1c0d-4ee5-9480-e8464410411c: creating. Jul 09 17:09:53 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 Jul 09 17:09:53 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Group snapshot 86555655-1c0d-4ee5-9480-e8464410411c: creating. {{(pid=86876) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Creating offline snapshot 8daaeab9-d604-4635-bc73-18190afaa906 of volume 1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437be9c-aada-4440-be98-6596514b2fa1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:53 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:09:53 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:53 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.322s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Deleted volume successfully. Jul 09 17:09:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-820232d2-ee04-4c09-93fc-975131b781d5 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-8e5ec930-9dcd-43aa-a3c3-27855b4eb6c9-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:54 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335" returned: 0 in 1.339s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:54 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335 Jul 09 17:09:54 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:54 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 1.258s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:54 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 1G Jul 09 17:09:54 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:55 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6f99a912-514f-4e58-b50d-ff4298dc4335" returned: 0 in 1.003s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-6f99a912-514f-4e58-b50d-ff4298dc4335" released by "delete_volume" :: held 2.421s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Created reservations ['6baa2c1c-6505-4c56-9143-b7a2e6ac1cbe', '45cdad1d-aadc-4aef-8aeb-8686684f7cac', '10dced31-9c54-4a22-b454-0d0f4b388cb9', '5f15096f-4db0-43d4-8f2b-fcde836442a2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:55 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:55 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:55 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 1G" returned: 0 in 1.135s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:55 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:09:55 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:56 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Deleted volume successfully. Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dce98119-c999-43b9-8b72-115387c37db0 tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-6f99a912-514f-4e58-b50d-ff4298dc4335-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-8a312cc4-738a-4f68-992d-3f2ca505b57e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-8a312cc4-738a-4f68-992d-3f2ca505b57e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "cinder-quobyte-8a312cc4-738a-4f68-992d-3f2ca505b57e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-8a312cc4-738a-4f68-992d-3f2ca505b57e" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e322ed8a-cdbe-4a31-84ae-e0914d10cca8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:56 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e Jul 09 17:09:56 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:56 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 0.946s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:56 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:09:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:56 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:09:56 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:57 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e" returned: 0 in 1.144s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:57 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e Jul 09 17:09:57 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:57 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 1.117s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:57 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info Jul 09 17:09:57 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:58 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8a312cc4-738a-4f68-992d-3f2ca505b57e" returned: 0 in 0.807s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-quobyte-8a312cc4-738a-4f68-992d-3f2ca505b57e" released by "delete_volume" :: held 2.032s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Created reservations ['e2609c9f-ba12-473a-8e3c-c21e01db78b5', '758876a3-1b30-4b36-a065-a87d962d5e83', 'ad3db2d5-587b-4a07-bec7-99c17b32f18c', '03ea5718-f92c-4e26-8f23-b2fbae0260e5'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:58 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:09:58 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:58 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info" returned: 0 in 1.012s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:58 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:09:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:09:58 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info Jul 09 17:09:58 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:09:59 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.883s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:59 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:09:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Deleted volume successfully. Jul 09 17:09:59 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 09 17:09:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.info" returned: 0 in 0.809s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:09:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.418s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:09:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9cfd4d89-3893-4575-860c-9c27b2d6f13b tempest-AttachVolumeTestJSON-1403084940 None] Lock "cinder-8a312cc4-738a-4f68-992d-3f2ca505b57e-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:09:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2ca0fbf-f13f-44fd-acbd-123a4012e09f tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 86555655-1c0d-4ee5-9480-e8464410411c: created successfully Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Flow 'volume_create_manager' (b3651837-40e9-4bc5-b6f2-98f1bec0e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca29a28-0f08-4119-abca-80a19050b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca29a28-0f08-4119-abca-80a19050b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1968277503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d604d9de-0489-4ee8-8131-6fabdfc5360e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d00dcacf5d446dc8e0258bb94de426e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:00Z,use_quota=True,user_id='48a6b988e4164e518d3c45379f637c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b56a97-3c8d-4058-a6f0-f3a45fcc60e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b56a97-3c8d-4058-a6f0-f3a45fcc60e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8c3f0e-ac2c-4fd4-acb7-05d9edd34ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8c3f0e-ac2c-4fd4-acb7-05d9edd34ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd604d9de-0489-4ee8-8131-6fabdfc5360e', 'volume_name': 'volume-d604d9de-0489-4ee8-8131-6fabdfc5360e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee84ba-d355-4400-b44f-a0c34b4aa463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee84ba-d355-4400-b44f-a0c34b4aa463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393c49f6-bb9b-4884-b044-223f043f989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:00 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Volume d604d9de-0489-4ee8-8131-6fabdfc5360e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d604d9de-0489-4ee8-8131-6fabdfc5360e', 'volume_size': 1} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1968277503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d604d9de-0489-4ee8-8131-6fabdfc5360e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d00dcacf5d446dc8e0258bb94de426e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:00Z,use_quota=True,user_id='48a6b988e4164e518d3c45379f637c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Creating volume d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:00 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:00 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e 1073741824 Jul 09 17:10:00 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:00 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:00 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:01 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e 1073741824" returned: 0 in 0.969s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:01 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:10:01 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:01 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.777s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:01 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 0.749s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.068s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906-33133d76-34e5-4787-91cb-a401056f5b50" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906-33133d76-34e5-4787-91cb-a401056f5b50" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Creating volume 33133d76-34e5-4787-91cb-a401056f5b50 from snapshot 8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393c49f6-bb9b-4884-b044-223f043f989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d604d9de-0489-4ee8-8131-6fabdfc5360e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93e8f6f-90a8-4e5f-b355-2aacb8774a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] snapshot: 8daaeab9-d604-4635-bc73-18190afaa906, volume: 33133d76-34e5-4787-91cb-a401056f5b50, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:10:02 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Volume volume-d604d9de-0489-4ee8-8131-6fabdfc5360e (d604d9de-0489-4ee8-8131-6fabdfc5360e): created successfully Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93e8f6f-90a8-4e5f-b355-2aacb8774a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Flow 'volume_create_manager' (b3651837-40e9-4bc5-b6f2-98f1bec0e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:02 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-32af8d63-ad74-4f63-a10b-b7bd57c62802 tempest-VolumesActionsTest-1099563779 None] Created volume successfully. Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954dde8-5bb3-4fe7-a074-e11db9da4a28]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:02 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:10:02 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:03 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 0.905s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450a68f-1ed1-483c-8e4d-b7f7104281f8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:03 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:10:03 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:03 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 0.851s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:10:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:03 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 Jul 09 17:10:03 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:10 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50" returned: 0 in 6.786s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e70a8f-10a4-4a05-a63a-5b108d2ba234]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:10 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:10:10 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:12 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:10:12 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:10:12 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 1.553s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:12 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:10:12 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Converted 1024.00 MB image at 150.85 MB/s Jul 09 17:10:12 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:10:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:12 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 Jul 09 17:10:12 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:13 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" released by "_copy_volume_from_snapshot" :: held 11.099s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906-33133d76-34e5-4787-91cb-a401056f5b50" released by "_create_volume_from_snapshot" :: held 11.143s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.163s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8f2664d9-83f4-4688-b4f0-a4dafa0e640e tempest-GroupSnapshotsTest-1390286325 None] Create group from source-snapshot-86555655-1c0d-4ee5-9480-e8464410411c completed successfully. Jul 09 17:10:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:14 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8952eb9f-7441-4ea4-9af9-dbd6413e3fb6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:14 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 Jul 09 17:10:14 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-8ac308a8-a69f-4701-ae2f-b49c4d219386 req-8cee1f6c-ef6a-46bd-a2e1-579f8e0dd599 tempest-TestMinimumBasicScenario-1303985952 None] Terminate volume connection completed successfully. Jul 09 17:10:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-8ac308a8-a69f-4701-ae2f-b49c4d219386 req-8cee1f6c-ef6a-46bd-a2e1-579f8e0dd599 tempest-TestMinimumBasicScenario-1303985952 None] Deleting attachment 9893c6dc-cd0e-490b-ad26-0f17d8e311e2. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:10:15 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50" returned: 0 in 0.947s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:15 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50 Jul 09 17:10:15 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:16 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-33133d76-34e5-4787-91cb-a401056f5b50" returned: 0 in 0.773s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-33133d76-34e5-4787-91cb-a401056f5b50" released by "delete_volume" :: held 1.766s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['1fc0953f-151c-4001-8e52-3975a8384a59'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:16 devstack cinder-volume[86876]: WARNING cinder.quota [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1451898323 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1451898323, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:10:16 devstack cinder-volume[86876]: WARNING cinder.quota [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1451898323 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1451898323, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['ef691c0c-d25c-4a29-ab2f-a934b5f4bec7', '71843553-b431-4f65-9cbe-39fc356a74ab', '21777310-4e76-40bd-8bc8-90a46f71e7f2', 'd1eb5a35-6f6f-4a34-803e-eaf7ebfd809d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:16 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:16 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 86555655-1c0d-4ee5-9480-e8464410411c: deleting Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 86555655-1c0d-4ee5-9480-e8464410411c: deleting {{(pid=86876) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Deleting offline snapshot 8daaeab9-d604-4635-bc73-18190afaa906 of volume 1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] snapshot_file for this snap is: volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[28361202-fa32-4ace-aa2a-ea5a7c2390ca]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:17 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.101s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:17 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-87b05055-3c7f-42f6-a8ca-16cb2baf6a3a tempest-GroupSnapshotsTest-1390286325 None] Delete group completed successfully. Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "cinder-07c7ffab-53b0-4ce6-a93d-77027a80e75f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "cinder-07c7ffab-53b0-4ce6-a93d-77027a80e75f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:18 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:10:18 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "cinder-quobyte-07c7ffab-53b0-4ce6-a93d-77027a80e75f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "cinder-quobyte-07c7ffab-53b0-4ce6-a93d-77027a80e75f" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[244efc38-177e-4dd5-a1ec-8f65f960a8ec]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:18 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f Jul 09 17:10:18 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:18 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 1.123s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a91d5-5e9a-40fd-8dad-c5696b3765b3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:19 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:10:19 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:19 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f" returned: 0 in 0.887s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:19 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f Jul 09 17:10:19 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:19 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 0.942s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:19 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:10:19 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:19 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-07c7ffab-53b0-4ce6-a93d-77027a80e75f" returned: 0 in 0.916s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "cinder-quobyte-07c7ffab-53b0-4ce6-a93d-77027a80e75f" released by "delete_volume" :: held 1.874s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Created reservations ['27a8e5c6-78fa-4259-87f7-198e22dcdd5d', '85be4b53-a9e0-49bb-a229-5a1c34a94502', '653725bd-87ef-4e6b-8a38-5175d3687d8b', '7052f823-aa2f-4294-b6e2-4b3ed78e77b1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:20 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:20 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:21 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.293s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:21 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Deleted volume successfully. Jul 09 17:10:21 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6e0ba74-cc3a-4e3b-83b8-2c63822e008f tempest-TestMinimumBasicScenario-1303985952 None] Lock "cinder-07c7ffab-53b0-4ce6-a93d-77027a80e75f-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 1.675s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:21 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906 Jul 09 17:10:21 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1fb8103-bc38-4e0f-b328-abf623bb0e2d tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" by "attach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1fb8103-bc38-4e0f-b328-abf623bb0e2d tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" acquired by "attach_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f1fb8103-bc38-4e0f-b328-abf623bb0e2d tempest-VolumesActionsTest-1099563779 None] Attaching volume d604d9de-0489-4ee8-8131-6fabdfc5360e to instance 2d3e88ed-1be7-46a8-969b-4dec096f6ca3 at mountpoint /dev/vdb on host None. Jul 09 17:10:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f1fb8103-bc38-4e0f-b328-abf623bb0e2d tempest-VolumesActionsTest-1099563779 None] Attach volume completed successfully. Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1fb8103-bc38-4e0f-b328-abf623bb0e2d tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" released by "attach_volume" :: held 0.165s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:22 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e.8daaeab9-d604-4635-bc73-18190afaa906" returned: 0 in 1.020s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8daaeab9-d604-4635-bc73-18190afaa906" released by "_delete_snapshot" :: held 5.018s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" released by "delete_snapshot" :: held 5.112s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:22 devstack cinder-volume[86876]: WARNING cinder.quota [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1451898323 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1451898323, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fc5fa222-4568-48cd-9da5-5ec61ec0e956 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" by "detach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fc5fa222-4568-48cd-9da5-5ec61ec0e956 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fc5fa222-4568-48cd-9da5-5ec61ec0e956 tempest-VolumesActionsTest-1099563779 None] Detaching volume d604d9de-0489-4ee8-8131-6fabdfc5360e from instance 2d3e88ed-1be7-46a8-969b-4dec096f6ca3. Jul 09 17:10:22 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['adb90919-695a-46c6-b2d8-8671aee8a3a9', '6440800c-601c-4677-a216-1d63fb822940', '87a44943-83cc-4d5d-84e9-06ccef1fff64', '98838e46-3364-4c40-8c9f-2570dd92fac2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fc5fa222-4568-48cd-9da5-5ec61ec0e956 tempest-VolumesActionsTest-1099563779 None] Detach volume completed successfully. Jul 09 17:10:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fc5fa222-4568-48cd-9da5-5ec61ec0e956 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f0800a7b-a19e-40e6-a6c3-f29364c1e8f5 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 86555655-1c0d-4ee5-9480-e8464410411c: deleted successfully Jul 09 17:10:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" acquired by "delete_volume" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bc719a-44bc-4fb6-b9e2-7ba102cd9281]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:24 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:10:24 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:25 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 1.057s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:25 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e Jul 09 17:10:25 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:26 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b56c4d3-ed87-49ea-8e9a-7818b968185e" returned: 0 in 0.914s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-1b56c4d3-ed87-49ea-8e9a-7818b968185e" released by "delete_volume" :: held 2.074s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['cdbf84b3-ad3a-4ad9-9b07-9dce1a0999fe'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:26 devstack cinder-volume[86876]: WARNING cinder.db.api [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1451898323'] Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['27519013-0082-4415-b419-00c7b2f3b4c8', 'd751df91-c726-4b91-8936-b744b765c93a', '6a3a05a8-cf74-4095-ae9a-dba1df3f3310', '4b8f0782-011f-4dd9-b4fb-c1e8f511815f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:26 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:26 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8abdf1a2-2930-4486-9343-ffc2762640f4 tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-442155499: creating Jul 09 17:10:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8abdf1a2-2930-4486-9343-ffc2762640f4 tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-442155499: created successfully Jul 09 17:10:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8abdf1a2-2930-4486-9343-ffc2762640f4 tempest-GroupSnapshotsTest-1390286325 None] Create group completed successfully. Jul 09 17:10:27 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.023s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:27 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aef4e19f-8f66-41fc-aa51-be223b09c76f tempest-GroupSnapshotsTest-1390286325 None] Delete group completed successfully. Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (012e4dc3-f5d5-49d3-bf93-2bd4a8050fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2ea80e-8ecb-43cd-8595-228c26ecf2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2ea80e-8ecb-43cd-8595-228c26ecf2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570572742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=613d456b-7502-4f78-b411-48425da4361f,host='devstack@QuobyteHD#QuobyteHD',id=67fa1ac8-37fc-480a-813f-907f3d9f4e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:29Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1dc5bd-d021-46a5-a765-157ca3e1c181),volume_type_id=2a1dc5bd-d021-46a5-a765-157ca3e1c181)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1ee099-4df1-454a-bf23-5844dbe8b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1ee099-4df1-454a-bf23-5844dbe8b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9572156b-d728-4e9c-9b4c-de0c4ad6094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9572156b-d728-4e9c-9b4c-de0c4ad6094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fa1ac8-37fc-480a-813f-907f3d9f4e0e', 'volume_name': 'volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0bc117-b944-4b61-ac18-2d24f0ad23df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0bc117-b944-4b61-ac18-2d24f0ad23df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d637385-e80e-483b-a752-68d6d4168c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Volume 67fa1ac8-37fc-480a-813f-907f3d9f4e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e', 'volume_size': 1} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=613d456b-7502-4f78-b411-48425da4361f,created_at=2026-07-09T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570572742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=613d456b-7502-4f78-b411-48425da4361f,host='devstack@QuobyteHD#QuobyteHD',id=67fa1ac8-37fc-480a-813f-907f3d9f4e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:29Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1dc5bd-d021-46a5-a765-157ca3e1c181),volume_type_id=2a1dc5bd-d021-46a5-a765-157ca3e1c181)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Creating volume 67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:29 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:29 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e 1073741824 Jul 09 17:10:29 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Flow 'volume_create_manager' (ce4a524f-fdd0-4da6-93fe-7336e94c7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd525a2-44ce-4626-9468-20dcc00f8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd525a2-44ce-4626-9468-20dcc00f8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115473613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ad333-c15b-4db9-bd79-a0ca75d18f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d7b15527274274bf1fc7943df16933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:29Z,use_quota=True,user_id='17c3d8bb52884e92967415b727608ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c0f94c-e568-43cf-86f3-3c1864ef0439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c0f94c-e568-43cf-86f3-3c1864ef0439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c7e8e-0637-47e7-8238-073c91a066c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c7e8e-0637-47e7-8238-073c91a066c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9ad333-c15b-4db9-bd79-a0ca75d18f78', 'volume_name': 'volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d0b1d0-7c0e-412e-8a40-7b05a45cd73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d0b1d0-7c0e-412e-8a40-7b05a45cd73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcadb7de-be94-4566-bf77-3a785dff1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume 7f9ad333-c15b-4db9-bd79-a0ca75d18f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78', 'volume_size': 1} Jul 09 17:10:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:30 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e 1073741824" returned: 0 in 0.944s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:30 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e Jul 09 17:10:30 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:30 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" returned: 0 in 0.778s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115473613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ad333-c15b-4db9-bd79-a0ca75d18f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d7b15527274274bf1fc7943df16933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:29Z,use_quota=True,user_id='17c3d8bb52884e92967415b727608ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Creating volume 7f9ad333-c15b-4db9-bd79-a0ca75d18f78 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:30 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:31 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 1073741824 Jul 09 17:10:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d637385-e80e-483b-a752-68d6d4168c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:31 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecf176-d1ea-4bb6-9d86-0e4238519f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Volume volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e (67fa1ac8-37fc-480a-813f-907f3d9f4e0e): created successfully Jul 09 17:10:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecf176-d1ea-4bb6-9d86-0e4238519f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (012e4dc3-f5d5-49d3-bf93-2bd4a8050fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-32fbfde8-2ef0-4969-92d3-8e4ef8a126f8 tempest-GroupSnapshotsTest-1390286325 None] Created volume successfully. Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (79aae4ca-91c4-48ce-97fc-5adf8fa39171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d47657-ea7a-45b4-9ee5-829d2489fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d47657-ea7a-45b4-9ee5-829d2489fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958321729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=613d456b-7502-4f78-b411-48425da4361f,host='devstack@QuobyteHD#QuobyteHD',id=b863b0d5-a545-4d01-8f43-0631a1ca559c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:32Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1dc5bd-d021-46a5-a765-157ca3e1c181),volume_type_id=2a1dc5bd-d021-46a5-a765-157ca3e1c181)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26475f7-0613-49bd-bc25-8eca7d1c992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26475f7-0613-49bd-bc25-8eca7d1c992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31024b59-3514-4871-8562-64842f413e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31024b59-3514-4871-8562-64842f413e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b863b0d5-a545-4d01-8f43-0631a1ca559c', 'volume_name': 'volume-b863b0d5-a545-4d01-8f43-0631a1ca559c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdaa82a-c669-4f63-a46b-b2dd14b17302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:32 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdaa82a-c669-4f63-a46b-b2dd14b17302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116a654a-49fb-4b73-b337-fa59b6c123ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:32 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Volume b863b0d5-a545-4d01-8f43-0631a1ca559c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b863b0d5-a545-4d01-8f43-0631a1ca559c', 'volume_size': 1} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 1073741824" returned: 0 in 1.444s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:32 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 Jul 09 17:10:32 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:33 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" returned: 0 in 0.797s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=613d456b-7502-4f78-b411-48425da4361f,created_at=2026-07-09T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958321729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=613d456b-7502-4f78-b411-48425da4361f,host='devstack@QuobyteHD#QuobyteHD',id=b863b0d5-a545-4d01-8f43-0631a1ca559c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:32Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1dc5bd-d021-46a5-a765-157ca3e1c181),volume_type_id=2a1dc5bd-d021-46a5-a765-157ca3e1c181)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Creating volume b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:33 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c 1073741824 Jul 09 17:10:33 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcadb7de-be94-4566-bf77-3a785dff1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9f460e-75cc-4dd5-bf89-f990443a66ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 (7f9ad333-c15b-4db9-bd79-a0ca75d18f78): created successfully Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9f460e-75cc-4dd5-bf89-f990443a66ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Flow 'volume_create_manager' (ce4a524f-fdd0-4da6-93fe-7336e94c7d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-349ed0d8-84a6-4c8d-9a10-1c4ef38ce532 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Created volume successfully. Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "cinder-7f9ad333-c15b-4db9-bd79-a0ca75d18f78-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "cinder-7f9ad333-c15b-4db9-bd79-a0ca75d18f78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "cinder-quobyte-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "cinder-quobyte-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76872ab-e537-4542-93ea-630995593eb3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:34 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 Jul 09 17:10:34 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:34 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c 1073741824" returned: 0 in 1.019s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:34 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c Jul 09 17:10:34 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:34 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:34 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78 Jul 09 17:10:34 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:35 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c" returned: 0 in 0.775s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116a654a-49fb-4b73-b337-fa59b6c123ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b863b0d5-a545-4d01-8f43-0631a1ca559c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470f0ff3-7167-41f7-9a2b-02d8bc15eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Volume volume-b863b0d5-a545-4d01-8f43-0631a1ca559c (b863b0d5-a545-4d01-8f43-0631a1ca559c): created successfully Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470f0ff3-7167-41f7-9a2b-02d8bc15eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (79aae4ca-91c4-48ce-97fc-5adf8fa39171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5fe94c90-41d1-4b9a-8809-7b6d08683e2a tempest-GroupSnapshotsTest-1390286325 None] Created volume successfully. Jul 09 17:10:35 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" returned: 0 in 0.721s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "cinder-quobyte-7f9ad333-c15b-4db9-bd79-a0ca75d18f78" released by "delete_volume" :: held 1.636s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Created reservations ['b38d806a-699f-4b5d-bd9d-53a47996f486', 'd173498a-aefc-4017-9e44-8471b6d24ad3', 'b801cb77-0cbb-4850-8b59-7eaa11ab5fee', '9415b201-57e7-4f71-a5ef-b30e41f3e008'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:35 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:35 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-47ca2137-0eb9-49d8-8e77-b3b51fc3eca4 tempest-GroupSnapshotsTest-1390286325 None] Update group completed successfully. Jul 09 17:10:36 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.953s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Deleted volume successfully. Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c47eeb5b-7613-4cef-bac4-7ffec9cc5348 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "cinder-7f9ad333-c15b-4db9-bd79-a0ca75d18f78-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Flow 'volume_create_manager' (abbaa546-62e7-4a38-bf92-416d91e87245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e20dabf-4135-476a-9d28-b096dda6ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e20dabf-4135-476a-9d28-b096dda6ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-436213298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be92ba8-dbf8-4330-8818-7e13de304b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d7b15527274274bf1fc7943df16933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:37Z,use_quota=True,user_id='17c3d8bb52884e92967415b727608ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9c4fe2-ba66-447f-89d7-5de5296e15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9c4fe2-ba66-447f-89d7-5de5296e15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2b4a9c-fd88-4c8c-832f-d02f63a6d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2b4a9c-fd88-4c8c-832f-d02f63a6d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be92ba8-dbf8-4330-8818-7e13de304b2a', 'volume_name': 'volume-7be92ba8-dbf8-4330-8818-7e13de304b2a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96c9c94-abfb-49ae-b87c-b6fcf0c0a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96c9c94-abfb-49ae-b87c-b6fcf0c0a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27653774-5d84-4099-b4c5-1dc8b97f1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:36 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume 7be92ba8-dbf8-4330-8818-7e13de304b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be92ba8-dbf8-4330-8818-7e13de304b2a', 'volume_size': 1} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-436213298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be92ba8-dbf8-4330-8818-7e13de304b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d7b15527274274bf1fc7943df16933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:37Z,use_quota=True,user_id='17c3d8bb52884e92967415b727608ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Creating volume 7be92ba8-dbf8-4330-8818-7e13de304b2a {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:36 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:36 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a 1073741824 Jul 09 17:10:37 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e85bcaef-e964-4523-b492-f386cdc5113a tempest-GroupSnapshotsTest-1390286325 None] Update group completed successfully. Jul 09 17:10:38 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a 1073741824" returned: 0 in 1.141s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:38 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a Jul 09 17:10:38 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-77faaee3-2e59-4630-a539-439533e2b3c7 tempest-GroupSnapshotsTest-1390286325 None] Update group completed successfully. Jul 09 17:10:39 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a" returned: 0 in 0.954s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27653774-5d84-4099-b4c5-1dc8b97f1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be92ba8-dbf8-4330-8818-7e13de304b2a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eade10f8-14fa-4961-9246-10aec1d9adda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Volume volume-7be92ba8-dbf8-4330-8818-7e13de304b2a (7be92ba8-dbf8-4330-8818-7e13de304b2a): created successfully Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eade10f8-14fa-4961-9246-10aec1d9adda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Flow 'volume_create_manager' (abbaa546-62e7-4a38-bf92-416d91e87245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e13183e8-e351-42ec-8998-74873103c658 tempest-VolumeQuotasAdminTestJSON-1492942213 None] Created volume successfully. Jul 09 17:10:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4079468e-ede1-496a-90ca-7bdd98c370e9 tempest-GroupSnapshotsTest-1390286325 None] Update group completed successfully. Jul 09 17:10:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-464fb252-30a9-4b72-83a3-353897f1230d tempest-VolumeQuotasAdminTestJSON-1854083811 None] Transfer volume completed successfully. Jul 09 17:10:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] GroupSnapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: creating. Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Group snapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: creating. {{(pid=86876) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Creating offline snapshot 41fd01e2-2cee-45a7-a852-9279ae9b7d0b of volume b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82db8fa-886a-402e-b1a0-bf7693d51a95]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:41 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c Jul 09 17:10:41 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Acquiring lock "cinder-7be92ba8-dbf8-4330-8818-7e13de304b2a-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "cinder-7be92ba8-dbf8-4330-8818-7e13de304b2a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Acquiring lock "cinder-quobyte-7be92ba8-dbf8-4330-8818-7e13de304b2a" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "cinder-quobyte-7be92ba8-dbf8-4330-8818-7e13de304b2a" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffc6dfa-98b3-47ce-bc6d-421b40b2fac7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:42 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a Jul 09 17:10:42 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:42 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c" returned: 0 in 1.035s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:42 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b 1G Jul 09 17:10:42 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:43 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a" returned: 0 in 0.939s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:43 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a Jul 09 17:10:43 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:44 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7be92ba8-dbf8-4330-8818-7e13de304b2a" returned: 0 in 1.012s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "cinder-quobyte-7be92ba8-dbf8-4330-8818-7e13de304b2a" released by "delete_volume" :: held 2.012s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Created reservations ['44b058fc-666f-4977-8ee5-a32704cb8aeb', 'd7056d83-5e5e-4cc7-bd16-1aa82d7d2869', '101671ba-06ba-442b-b6a6-b726028eb507', '0207c478-672c-4167-b6ab-d29a0ed81224'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:10:44 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b 1G" returned: 0 in 1.473s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b863b0d5-a545-4d01-8f43-0631a1ca559c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:44 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b863b0d5-a545-4d01-8f43-0631a1ca559c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:44 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:44 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:10:44 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:45 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b863b0d5-a545-4d01-8f43-0631a1ca559c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b" returned: 0 in 1.018s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:45 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:10:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:45 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b Jul 09 17:10:45 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:45 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.088s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:45 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:10:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Deleted volume successfully. Jul 09 17:10:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ca30da43-4954-4008-9559-cf1b9fb8f0db tempest-VolumeQuotasAdminTestJSON-1989575495 None] Lock "cinder-7be92ba8-dbf8-4330-8818-7e13de304b2a-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:46 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b" returned: 0 in 1.048s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:46 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info Jul 09 17:10:46 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:47 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info" returned: 0 in 1.145s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:47 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:10:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:47 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info Jul 09 17:10:47 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:48 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.info" returned: 0 in 1.307s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.175s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Creating offline snapshot c83dcaa3-cbed-490e-ad33-5de1910ac283 of volume 67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:10:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3914ff40-9a8e-4829-9f7b-b253dd0f552d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:49 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e Jul 09 17:10:49 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-058fd690-92ba-4de5-8740-07e9af77e904 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" by "attach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-058fd690-92ba-4de5-8740-07e9af77e904 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" acquired by "attach_volume" :: waited 0.033s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-058fd690-92ba-4de5-8740-07e9af77e904 tempest-VolumesActionsTest-1099563779 None] Attaching volume d604d9de-0489-4ee8-8131-6fabdfc5360e to instance 8c279abf-418e-4898-8e02-4541ad6571d6 at mountpoint /dev/vdb on host None. Jul 09 17:10:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-058fd690-92ba-4de5-8740-07e9af77e904 tempest-VolumesActionsTest-1099563779 None] Attach volume completed successfully. Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-058fd690-92ba-4de5-8740-07e9af77e904 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e" released by "attach_volume" :: held 0.214s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:50 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" returned: 0 in 1.474s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:50 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 1G Jul 09 17:10:50 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4d95e436-e76c-42c0-aab3-b60d3094c6aa tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" by "detach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4d95e436-e76c-42c0-aab3-b60d3094c6aa tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4d95e436-e76c-42c0-aab3-b60d3094c6aa tempest-VolumesActionsTest-1099563779 None] Detaching volume d604d9de-0489-4ee8-8131-6fabdfc5360e from instance 8c279abf-418e-4898-8e02-4541ad6571d6. Jul 09 17:10:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4d95e436-e76c-42c0-aab3-b60d3094c6aa tempest-VolumesActionsTest-1099563779 None] Detach volume completed successfully. Jul 09 17:10:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4d95e436-e76c-42c0-aab3-b60d3094c6aa tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:10:52 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 1G" returned: 0 in 1.613s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:52 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 Jul 09 17:10:52 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:53 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283" returned: 0 in 1.114s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:53 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:10:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:53 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 Jul 09 17:10:53 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:54 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283" returned: 0 in 0.796s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:54 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info Jul 09 17:10:54 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:54 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info" returned: 0 in 0.828s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:10:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:54 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info Jul 09 17:10:54 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Flow 'volume_create_manager' (c408b7dc-1faf-4c96-bc87-325fc93d69ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b592a53-9525-4559-b5ef-769da9c80800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b592a53-9525-4559-b5ef-769da9c80800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1896969487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1451fc17-e867-4fd2-9b40-d3305e3e18ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606fc54dab84c11afdb848c2a886215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:56Z,use_quota=True,user_id='3ba655695953468daf16ae26897b2477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f33e30-7438-4c6f-a7b3-71696103283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f33e30-7438-4c6f-a7b3-71696103283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87411ae-2913-4afe-a159-63c34774d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87411ae-2913-4afe-a159-63c34774d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1451fc17-e867-4fd2-9b40-d3305e3e18ef', 'volume_name': 'volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc5189f-3ce7-4e80-a45d-f42e459679be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc5189f-3ce7-4e80-a45d-f42e459679be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc27687-a654-43c4-a3a8-3133eab3b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Volume 1451fc17-e867-4fd2-9b40-d3305e3e18ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef', 'volume_size': 1} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:55 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.info" returned: 0 in 0.889s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.839s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1896969487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1451fc17-e867-4fd2-9b40-d3305e3e18ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606fc54dab84c11afdb848c2a886215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:10:56Z,use_quota=True,user_id='3ba655695953468daf16ae26897b2477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Creating volume 1451fc17-e867-4fd2-9b40-d3305e3e18ef {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:10:55 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:10:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:55 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef 1073741824 Jul 09 17:10:55 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8fb6f91e-aa6e-472a-a583-488d22314644 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: created successfully Jul 09 17:10:56 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef 1073741824" returned: 0 in 0.958s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:56 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef Jul 09 17:10:56 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] group_snapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: deleting Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] group_snapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: deleting {{(pid=86876) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-41fd01e2-2cee-45a7-a852-9279ae9b7d0b" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-41fd01e2-2cee-45a7-a852-9279ae9b7d0b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Deleting offline snapshot 41fd01e2-2cee-45a7-a852-9279ae9b7d0b of volume b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] snapshot_file for this snap is: volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75cbcf3-50b9-47f3-9635-e60739e5df1b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:57 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b Jul 09 17:10:57 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:57 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef" returned: 0 in 0.947s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc27687-a654-43c4-a3a8-3133eab3b29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d389eacf-3db0-418a-a50c-14e973c78ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:10:57 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Volume volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef (1451fc17-e867-4fd2-9b40-d3305e3e18ef): created successfully Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d389eacf-3db0-418a-a50c-14e973c78ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:10:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Flow 'volume_create_manager' (c408b7dc-1faf-4c96-bc87-325fc93d69ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:10:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fbbaf795-9053-452d-a6fb-f2a8a94f27bd tempest-VolumeQuotasNegativeTestJSON-92074287 None] Created volume successfully. Jul 09 17:10:58 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b" returned: 0 in 0.946s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b863b0d5-a545-4d01-8f43-0631a1ca559c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:10:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb32a25-afa4-4d0d-bde1-156e72845ceb]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:10:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:58 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c Jul 09 17:10:58 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:10:59 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 09 17:10:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c" returned: 0 in 0.864s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:10:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:10:59 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b Jul 09 17:10:59 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:00 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b" returned: 0 in 1.015s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:00 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b Jul 09 17:11:00 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Acquiring lock "cinder-1451fc17-e867-4fd2-9b40-d3305e3e18ef-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "cinder-1451fc17-e867-4fd2-9b40-d3305e3e18ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Acquiring lock "cinder-quobyte-1451fc17-e867-4fd2-9b40-d3305e3e18ef" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "cinder-quobyte-1451fc17-e867-4fd2-9b40-d3305e3e18ef" acquired by "delete_volume" :: waited 0.056s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:00 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:00 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c1cf5-fb11-4803-991b-1b922f5eab34]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:00 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef Jul 09 17:11:00 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:01 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c.41fd01e2-2cee-45a7-a852-9279ae9b7d0b" returned: 0 in 0.960s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-41fd01e2-2cee-45a7-a852-9279ae9b7d0b" released by "_delete_snapshot" :: held 3.961s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" released by "delete_snapshot" :: held 4.001s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-c83dcaa3-cbed-490e-ad33-5de1910ac283" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-c83dcaa3-cbed-490e-ad33-5de1910ac283" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Deleting offline snapshot c83dcaa3-cbed-490e-ad33-5de1910ac283 of volume 67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] snapshot_file for this snap is: volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf36f5-c84d-4b36-b948-e5bcfb41259e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:01 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.957s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 8 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:11:01 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 Jul 09 17:11:01 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:01 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef" returned: 0 in 0.973s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:01 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef Jul 09 17:11:01 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60a7a74-c5c4-4738-9692-c04292ba1a6b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:01 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:01 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:02 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283" returned: 0 in 0.981s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ef342-efb4-4c6c-b009-09b9b923078b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:02 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1451fc17-e867-4fd2-9b40-d3305e3e18ef" returned: 0 in 0.856s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "cinder-quobyte-1451fc17-e867-4fd2-9b40-d3305e3e18ef" released by "delete_volume" :: held 1.896s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:02 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e Jul 09 17:11:02 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Created reservations ['d6f1fa3e-3902-411b-9290-18538f4abc33', '10655c56-9fae-4cae-8be9-e79c1f324fcf', '028850a8-fe29-4e21-9a09-408f78c5eae4', 'fb87ef7d-f3d8-466b-807f-b9b04d1d09f8'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:02 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:02 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:02 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 1.013s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6012294-937d-4466-9257-1b021beceb8e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:02 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:02 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:03 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.875s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Deleted volume successfully. Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-93080cc7-32ed-4123-ae1e-c3fe4462bb5f tempest-VolumeQuotasNegativeTestJSON-92074287 None] Lock "cinder-1451fc17-e867-4fd2-9b40-d3305e3e18ef-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:03 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" returned: 0 in 1.483s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:03 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 Jul 09 17:11:03 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:03 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 1.187s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.51790a01-dff4-42f4-bd5d-b5a9ccf8d70ejjk29k1b.img {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:03 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.51790a01-dff4-42f4-bd5d-b5a9ccf8d70ejjk29k1b.img Jul 09 17:11:03 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:05 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283" returned: 0 in 1.426s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:05 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283 Jul 09 17:11:05 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:06 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e.c83dcaa3-cbed-490e-ad33-5de1910ac283" returned: 0 in 1.688s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-c83dcaa3-cbed-490e-ad33-5de1910ac283" released by "_delete_snapshot" :: held 5.764s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" released by "delete_snapshot" :: held 5.811s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:07 devstack cinder-volume[86876]: WARNING cinder.quota [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1295774625 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1295774625, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:11:07 devstack cinder-volume[86876]: WARNING cinder.quota [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1295774625 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1295774625, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:11:07 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['350f79cf-140b-4358-bcde-56a5ca92333b', '34d102aa-c2f3-4cd4-af70-eb06d3ed5f78', 'c6a8b432-0d23-41f1-8103-08f63fd71cc2', 'b8a3b4bf-f92f-4b99-8e9f-d22fdf558760'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:07 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['4f67093d-4268-4823-853f-dfe12bdf5e1d', '38831a21-aaa8-4ab3-a50a-ffae3f5bbe06', '338c9afb-b7bb-48e7-92be-a7171386b75e', 'ebaa5f1c-5527-4d6e-932a-ec76b4c540d9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:07 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1e018c6d-f70b-4156-8276-389c481d729f tempest-GroupSnapshotsTest-1390286325 None] group_snapshot f34a9f9c-f145-44d3-b82f-96c87f4fcd66: deleted successfully Jul 09 17:11:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" acquired by "delete_volume" :: waited 0.062s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99aae10-89b1-4679-8e22-183a8726d740]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:10 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e Jul 09 17:11:10 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:10 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.51790a01-dff4-42f4-bd5d-b5a9ccf8d70ejjk29k1b.img" returned: 0 in 6.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a8a30-af1b-4226-826e-904864bbbf74]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:10 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:10 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:11 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" returned: 0 in 1.127s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:11 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e Jul 09 17:11:11 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:12 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:12 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 1.524s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.51790a01-dff4-42f4-bd5d-b5a9ccf8d70ejjk29k1b.img {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:11:12 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Converted 1024.00 MB image at 152.64 MB/s Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=92,cinder:SELECT=109,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=114,cinder:SELECT=96,cinder:INSERT=21,cinder:DELETE=4 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" returned: 0 in 1.009s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] 51790a01-dff4-42f4-bd5d-b5a9ccf8d70e was raw, no need to convert to raw {{(pid=86876) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-67fa1ac8-37fc-480a-813f-907f3d9f4e0e" released by "delete_volume" :: held 2.316s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed86351-9b72-4a8e-bd16-6a6b83530c7a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:12 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c Jul 09 17:11:12 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:13 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c" returned: 0 in 1.221s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:13 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c Jul 09 17:11:13 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:14 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b863b0d5-a545-4d01-8f43-0631a1ca559c" returned: 0 in 1.031s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-b863b0d5-a545-4d01-8f43-0631a1ca559c" released by "delete_volume" :: held 2.325s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['d17bafd7-62b1-4e71-8efc-f9a8447e95ac'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:14 devstack cinder-volume[86876]: WARNING cinder.quota [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1295774625 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1295774625, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['23bb5e12-5ddb-4361-b54c-7e6b2fc4f994', 'e1863c90-d320-4f8b-a914-2c215b7e77a3', '66d215de-4585-400e-82a3-a205fedbe8cf', 'dc9acebf-6909-4bd9-906a-45266105c0f1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['a29bec21-9554-40d0-bd45-03d10bf8848e', '7af0e66b-2094-4776-b1ff-c0b235bfaf1d', '77ec180e-3c3e-45e7-8bfb-2acff4f51d9c', 'fa7db190-e57a-4f6a-b571-a7d15e16480d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:15 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:15 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:16 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.163s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:16 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d436369a-84a5-44aa-8b0f-06dd67d3c5ca tempest-GroupSnapshotsTest-1390286325 None] Delete group completed successfully. Jul 09 17:11:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-261bc2f2-c9df-49ff-8e75-14b7efdd826f tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-1297248786: creating Jul 09 17:11:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-261bc2f2-c9df-49ff-8e75-14b7efdd826f tempest-GroupSnapshotsTest-1390286325 None] Group tempest-GroupSnapshotsTest-Group-1297248786: created successfully Jul 09 17:11:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-261bc2f2-c9df-49ff-8e75-14b7efdd826f tempest-GroupSnapshotsTest-1390286325 None] Create group completed successfully. Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Flow 'volume_create_manager' (574c91a6-b1bc-4516-9e49-f9b80236a001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf8470-d28e-40a1-9405-e1cd6c340b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf8470-d28e-40a1-9405-e1cd6c340b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1650053819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c29c234-a50a-4ec0-a6a4-ed43e61a47fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0c1657809249f992bef6fc10e2ce7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:17Z,use_quota=True,user_id='7d46b445919848509211ac6dda4d0186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1698c0f3-1223-456e-b0d6-15b236f8553e),volume_type_id=1698c0f3-1223-456e-b0d6-15b236f8553e)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db8775-a483-44ea-9df2-99e23a3e53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db8775-a483-44ea-9df2-99e23a3e53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e10e1f-5ef1-4337-80ee-7b219c436cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e10e1f-5ef1-4337-80ee-7b219c436cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c29c234-a50a-4ec0-a6a4-ed43e61a47fd', 'volume_name': 'volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ce15d6-0d15-46de-8046-ab7ab532ad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ce15d6-0d15-46de-8046-ab7ab532ad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed5fb65-e21e-4ce0-9a48-d810ee1bf0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Volume 4c29c234-a50a-4ec0-a6a4-ed43e61a47fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd', 'volume_size': 1} Jul 09 17:11:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (fa355cb8-8e07-492f-85fd-b84810344608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ba7d3d-8bc0-44c6-907b-b4bc308c04f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ba7d3d-8bc0-44c6-907b-b4bc308c04f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160335973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9435602b-239e-4857-a3b2-c0d479549886,host='devstack@QuobyteHD#QuobyteHD',id=8c9fa031-facd-4acc-815e-397c1df2b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:18Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6ff5460-4ded-4227-b0fe-0fe678a38dd7),volume_type_id=e6ff5460-4ded-4227-b0fe-0fe678a38dd7)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5339ba98-6dc6-499e-a8ba-4c38a9016840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5339ba98-6dc6-499e-a8ba-4c38a9016840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d704eb27-4916-44c2-b6b1-2ba518aa2c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d704eb27-4916-44c2-b6b1-2ba518aa2c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9fa031-facd-4acc-815e-397c1df2b1a9', 'volume_name': 'volume-8c9fa031-facd-4acc-815e-397c1df2b1a9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ebf1ff-1c43-419e-b30e-08bb8328ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ebf1ff-1c43-419e-b30e-08bb8328ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8c5612-7e43-4da0-84e7-41e243330d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Volume 8c9fa031-facd-4acc-815e-397c1df2b1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9fa031-facd-4acc-815e-397c1df2b1a9', 'volume_size': 1} Jul 09 17:11:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Flow 'volume_create_manager' (d326cd4e-01fd-49cf-9897-2dd842b78ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e716610-fd3f-4ff0-a03d-ee9c7d7c24ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e716610-fd3f-4ff0-a03d-ee9c7d7c24ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-77074991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d31bc1-f81e-4d82-a3fd-2113013dc1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0edd7e16fbc46dd907e63daa9ac1812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:20Z,use_quota=True,user_id='c69fb91eaa774b45a98ad6f0bc870d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcae42a-f538-4445-8d11-c28868f6603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcae42a-f538-4445-8d11-c28868f6603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff16a760-79ab-4008-9885-171aad382f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff16a760-79ab-4008-9885-171aad382f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'volume_name': 'volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757f2f6d-dbd1-4475-9881-31277795834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757f2f6d-dbd1-4475-9881-31277795834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560c438c-5bb8-40b6-ae53-e3141dd27f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:20 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Trying to clone 45d31bc1-f81e-4d82-a3fd-2113013dc1fe from image cd66455c-9772-4d79-b400-0ea9cf463a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:11:20 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Image download 20.69 MB at 20.69 MB/s Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5e6225-148c-427d-b4b8-94166f62e4c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:21 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD Jul 09 17:11:21 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:21 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:21 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 is fetched for user c69fb91eaa774b45a98ad6f0bc870d52. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:11:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c5d670-7eb8-406a-8a43-36f9eb1e2775]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:21 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD Jul 09 17:11:21 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:22 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:31 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=20,cinder:SELECT=22,cinder:INSERT=3 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:11:31 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.469s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Uploaded volume to glance image-id: 51790a01-dff4-42f4-bd5d-b5a9ccf8d70e. {{(pid=86876) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.718s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1650053819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c29c234-a50a-4ec0-a6a4-ed43e61a47fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0c1657809249f992bef6fc10e2ce7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:17Z,use_quota=True,user_id='7d46b445919848509211ac6dda4d0186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1698c0f3-1223-456e-b0d6-15b236f8553e),volume_type_id=1698c0f3-1223-456e-b0d6-15b236f8553e)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Creating volume 4c29c234-a50a-4ec0-a6a4-ed43e61a47fd {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:11:34 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:34 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd 1073741824 Jul 09 17:11:34 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-04c0b4d1-1b03-41a9-9c4d-9288254a3826 tempest-VolumesActionsTest-1099563779 None] Copy volume to image completed successfully. Jul 09 17:11:34 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd 1073741824" returned: 0 in 0.835s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:35 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd Jul 09 17:11:35 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:35 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" returned: 0 in 0.642s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.467s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9435602b-239e-4857-a3b2-c0d479549886,created_at=2026-07-09T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160335973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9435602b-239e-4857-a3b2-c0d479549886,host='devstack@QuobyteHD#QuobyteHD',id=8c9fa031-facd-4acc-815e-397c1df2b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ddf8c9d0f4378ad27384f00285edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:18Z,use_quota=True,user_id='ed0ee6e8b0e34e16bf504a7a0237a093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6ff5460-4ded-4227-b0fe-0fe678a38dd7),volume_type_id=e6ff5460-4ded-4227-b0fe-0fe678a38dd7)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Creating volume 8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:11:35 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:35 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 1073741824 Jul 09 17:11:35 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed5fb65-e21e-4ce0-9a48-d810ee1bf0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b54f86-f294-408a-8f76-4a9a15bdd176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Volume volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd (4c29c234-a50a-4ec0-a6a4-ed43e61a47fd): created successfully Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b54f86-f294-408a-8f76-4a9a15bdd176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Flow 'volume_create_manager' (574c91a6-b1bc-4516-9e49-f9b80236a001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-97abf9d1-fdd5-4281-a403-a264d4e5c389 tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Created volume successfully. Jul 09 17:11:36 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 1073741824" returned: 0 in 0.775s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:36 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 Jul 09 17:11:36 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:36 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:36 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:37 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9" returned: 0 in 0.651s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.646s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-77074991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d31bc1-f81e-4d82-a3fd-2113013dc1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0edd7e16fbc46dd907e63daa9ac1812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:11:20Z,use_quota=True,user_id='c69fb91eaa774b45a98ad6f0bc870d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Creating volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:11:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:37 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1073741824 Jul 09 17:11:37 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8c5612-7e43-4da0-84e7-41e243330d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9fa031-facd-4acc-815e-397c1df2b1a9', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3176ebb-ac53-43d1-92c3-63b3e14b0ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Volume volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 (8c9fa031-facd-4acc-815e-397c1df2b1a9): created successfully Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3176ebb-ac53-43d1-92c3-63b3e14b0ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Flow 'volume_create_manager' (fa355cb8-8e07-492f-85fd-b84810344608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8d19c9e2-e827-4b50-a410-219c06ed89a0 tempest-GroupSnapshotsTest-1390286325 None] Created volume successfully. Jul 09 17:11:37 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.686s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8b38eab8-a5e5-459d-b91b-58b0a35f940b tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Retype volume completed successfully. Jul 09 17:11:37 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1073741824" returned: 0 in 0.802s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:37 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] GroupSnapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: creating. Jul 09 17:11:37 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Group snapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: creating. {{(pid=86876) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "cinder-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "cinder-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "cinder-quobyte-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "cinder-quobyte-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636ad06-e942-4860-8aeb-292012904fa7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:38 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd Jul 09 17:11:38 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:38 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 0.655s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.450s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa84f2-3495-49df-b271-e869d2258918]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Attempting download of cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8504ac2-9c44-4f89-8c78-fe95d32e2450]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:38 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:38 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:38 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk Jul 09 17:11:38 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:39 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" returned: 0 in 0.857s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:39 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd Jul 09 17:11:39 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:39 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 0.831s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cacdca4-6bc5-4da9-aefe-25ae41f3be86]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:39 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk" returned: 0 in 0.817s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:39 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:39 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:39 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk Jul 09 17:11:39 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:40 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" returned: 0 in 0.686s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "cinder-quobyte-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd" released by "delete_volume" :: held 1.584s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:40 devstack cinder-volume[86876]: WARNING cinder.quota [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:11:40 devstack cinder-volume[86876]: WARNING cinder.quota [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Created reservations ['0c2403c6-7945-42a2-a463-db35e6b3e9e1', '3d5ebe0e-8154-422d-af28-0b3d57be5941', '50fbb556-64bd-4f4d-9822-069748b902b4', '4a2c0dbf-4863-4aac-97d3-81440de9a473'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:40 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:40 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:40 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:40 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk" returned: 1 in 0.859s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_ekbbj7wk' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:11:40 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2827b-264f-449c-b52c-0294f9003703]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:40 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:40 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD Jul 09 17:11:40 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:41 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.842s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Deleted volume successfully. Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-df5a1fdd-3703-432b-bcba-f6b6bc853cbe tempest-VolumeRetypeWithoutMigrationTest-1158234437 None] Lock "cinder-4c29c234-a50a-4ec0-a6a4-ed43e61a47fd-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:41 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] cd66455c-9772-4d79-b400-0ea9cf463a75 was qcow2, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:11:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:41 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:41 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:45 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 4.453s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:45 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_5mmqg61zdevstack@QuobyteHD, size 112.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:11:45 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Converted 112.00 MB image at 25.11 MB/s Jul 09 17:11:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:45 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1G Jul 09 17:11:45 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:46 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img" returned: 0 in 5.964s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc71735-b37f-4ff9-a109-e7695f75b53f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:46 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:46 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:46 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe 1G" returned: 0 in 1.005s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf960f1-0bbf-4c35-8365-b2d699621be3]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:46 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:46 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:47 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 1.019s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:11:47 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Converted 1024.00 MB image at 171.66 MB/s Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] 501da3ea-43cc-47e5-927d-d9db19db9459 was raw, converting to qcow2 {{(pid=86876) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c5153-95c0-4aec-b355-dbca8f8b919c]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:47 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img Jul 09 17:11:47 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:47 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:47 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:47 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:48 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img" returned: 0 in 0.792s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:48 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img Jul 09 17:11:48 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:48 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 1 in 0.827s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Downloaded image cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 for user c69fb91eaa774b45a98ad6f0bc870d52 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Marking volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Copying metadata from image cd66455c-9772-4d79-b400-0ea9cf463a75 to 45d31bc1-f81e-4d82-a3fd-2113013dc1fe. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Creating volume glance metadata for volume 45d31bc1-f81e-4d82-a3fd-2113013dc1fe backed by image cd66455c-9772-4d79-b400-0ea9cf463a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560c438c-5bb8-40b6-ae53-e3141dd27f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5194eec4-c04a-4941-bfd3-8a7666fcf9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:11:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Volume volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe (45d31bc1-f81e-4d82-a3fd-2113013dc1fe): created successfully Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5194eec4-c04a-4941-bfd3-8a7666fcf9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Flow 'volume_create_manager' (d326cd4e-01fd-49cf-9897-2dd842b78ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:11:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e42f40ba-2f2a-45e1-8458-98e09d3180e3 tempest-TestShelveInstance-906958860 None] Created volume successfully. Jul 09 17:11:48 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img" returned: 1 in 0.807s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:11:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:49 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm Jul 09 17:11:49 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:49 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:49 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Image conversion details: src /opt/stack/data/cinder/conversion/d604d9de-0489-4ee8-8131-6fabdfc5360e.temp_image.501da3ea-43cc-47e5-927d-d9db19db945978pzt193.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:11:49 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 17:11:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b211f44-e1e4-4a14-ab8b-538fda5d3af4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:49 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm Jul 09 17:11:49 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:50 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3qo1thm" returned: 0 in 0.756s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.650s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Uploaded volume to glance image-id: 501da3ea-43cc-47e5-927d-d9db19db9459. {{(pid=86876) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.256s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Creating offline snapshot 8d60f3fe-8d87-4f05-9431-0cddbcebb5ff of volume 8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:11:52 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c2050308-9953-4be8-8403-64b144405117 tempest-VolumesActionsTest-1099563779 None] Copy volume to image completed successfully. Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d540b-4a09-4441-a179-68a7a0196670]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:52 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 Jul 09 17:11:52 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:53 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:53 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff 1G Jul 09 17:11:53 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:54 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff 1G" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:54 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff Jul 09 17:11:54 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "cinder-quobyte-d604d9de-0489-4ee8-8131-6fabdfc5360e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-quobyte-d604d9de-0489-4ee8-8131-6fabdfc5360e" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[75148dd4-b132-4ab8-972d-8250b541722d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:54 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:54 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:54 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" returned: 0 in 0.873s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:11:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:54 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff Jul 09 17:11:54 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:55 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 0.877s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:55 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e Jul 09 17:11:55 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:55 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" returned: 0 in 0.882s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:55 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info Jul 09 17:11:55 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:55 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d604d9de-0489-4ee8-8131-6fabdfc5360e" returned: 0 in 0.887s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-quobyte-d604d9de-0489-4ee8-8131-6fabdfc5360e" released by "delete_volume" :: held 1.820s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Created reservations ['3f907ce4-87f8-4202-9cba-7a809820bf78', 'c87cfb7a-bb9f-42b8-937e-fcdd4534d166', 'c3f05211-9775-4082-ab82-5feb47598692', '71c5fa35-52a2-4332-b86d-91a25d8c0961'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:56 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:11:56 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:57 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info" returned: 0 in 1.270s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:57 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:57 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info Jul 09 17:11:57 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:57 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.221s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:11:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Deleted volume successfully. Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6ec0a584-6697-481f-807f-65bc0870dcc3 tempest-VolumesActionsTest-1099563779 None] Lock "cinder-d604d9de-0489-4ee8-8131-6fabdfc5360e-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:11:57 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.info" returned: 0 in 0.862s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.729s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.595s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b449cfb-1ab0-48fb-9ab5-405df6c071a9]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f3f563ea-ebe2-42f9-9d2b-7f83629d33ac tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: created successfully Jul 09 17:11:58 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:58 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: deleting Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: deleting {{(pid=86876) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Deleting offline snapshot 8d60f3fe-8d87-4f05-9431-0cddbcebb5ff of volume 8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] snapshot_file for this snap is: volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733722d-4abd-45a2-bc82-1f10a4feb8a9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:58 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff Jul 09 17:11:58 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:58 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 0.875s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:59 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:11:59 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:11:59 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" returned: 0 in 1.062s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c9fa031-facd-4acc-815e-397c1df2b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d3a868-eee8-4837-8f88-0599d6af8752]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:11:59 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 1 in 1.004s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:11:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.937s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:11:59 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 Jul 09 17:11:59 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3175039-51cd-4fca-a452-518121b1eeb2', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:12:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-f5db3d0e-bcd7-4360-9246-3f0e3c54dfb5 req-36ff0c91-5288-46f1-84f3-96dc30324447 tempest-TestShelveInstance-906958860 None] attachment_update completed successfully. Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:00 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:00 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:00 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9" returned: 0 in 1.071s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:00 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff Jul 09 17:12:00 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:01 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.068s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:12:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 28 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:12:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:12:02 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" returned: 0 in 1.133s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:02 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff Jul 09 17:12:02 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:02 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9.8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" returned: 0 in 0.771s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8d60f3fe-8d87-4f05-9431-0cddbcebb5ff" released by "_delete_snapshot" :: held 4.231s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" released by "delete_snapshot" :: held 4.296s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:03 devstack cinder-volume[86876]: WARNING cinder.quota [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-593793404 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-593793404, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:03 devstack cinder-volume[86876]: WARNING cinder.quota [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-593793404 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-593793404, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['60d343a4-b088-4478-9c40-07cc300b8ccd', 'cca7a9c8-c5cc-4e11-8046-54b6b97489a1', 'd5ffb38e-9f7d-4e43-be83-2af86d137f30', 'f2b9955e-e72e-431c-b87e-ab7efee022e4'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-55b277dc-1bbf-4b30-b333-7d86092a2d51 tempest-GroupSnapshotsTest-1390286325 None] group_snapshot 3ccabcef-ce6c-444b-965a-2ca52368b370: deleted successfully Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Flow 'volume_create_manager' (973d66a2-24a8-450a-82bb-e69f8b7c1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc0face-5175-4b26-82c2-8f27b244b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc0face-5175-4b26-82c2-8f27b244b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-100714531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf94c29-df13-4edd-8b01-f54a218d1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12d0bb41fa34125bcd451812395cb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:04Z,use_quota=True,user_id='4a907df808614d5bb4dfcd7fb6bcb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253fc2a3-faba-4ad9-a9b1-bbf34817471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253fc2a3-faba-4ad9-a9b1-bbf34817471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a250796-4a82-4154-99c9-72de407b1806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:03 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a250796-4a82-4154-99c9-72de407b1806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdf94c29-df13-4edd-8b01-f54a218d1f06', 'volume_name': 'volume-fdf94c29-df13-4edd-8b01-f54a218d1f06', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86f1af-107c-459f-b370-d309a4188919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86f1af-107c-459f-b370-d309a4188919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3146f1-1205-42d5-a162-5668e9902571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:04 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Volume fdf94c29-df13-4edd-8b01-f54a218d1f06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdf94c29-df13-4edd-8b01-f54a218d1f06', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Trying to clone fdf94c29-df13-4edd-8b01-f54a218d1f06 from image cd66455c-9772-4d79-b400-0ea9cf463a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" acquired by "delete_volume" :: waited 0.062s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[456aca7d-1c50-49e7-9e47-ca4ce166a03c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:05 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 Jul 09 17:12:05 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:12:05 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Image download 20.69 MB at 20.69 MB/s Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e26ff8d-96e0-4d07-865e-a570d3885298]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:05 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD Jul 09 17:12:05 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Flow 'volume_create_manager' (93aff1b5-7992-4bbd-b1a8-b533d51202ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15735832-9a96-4038-8c52-ef959b84e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15735832-9a96-4038-8c52-ef959b84e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510060022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b74dfbb-9b44-4b54-a635-bdb227ac8595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6710694c2bc48be94c91af63d02de4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:06Z,use_quota=True,user_id='2de3cb67e6e545368173fe74bc07cff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8b0e3-d018-4142-aeaf-6d54d3354711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a8b0e3-d018-4142-aeaf-6d54d3354711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca66356-c984-4d2e-95bc-8a0c937df31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca66356-c984-4d2e-95bc-8a0c937df31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b74dfbb-9b44-4b54-a635-bdb227ac8595', 'volume_name': 'volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595', 'volume_size': 2}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beca1b2d-1544-43cb-a777-3ea4e4b86156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beca1b2d-1544-43cb-a777-3ea4e4b86156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baf016-f93a-4ccb-8e20-16c0fefc5a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:05 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Volume 4b74dfbb-9b44-4b54-a635-bdb227ac8595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595', 'volume_size': 2} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510060022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b74dfbb-9b44-4b54-a635-bdb227ac8595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6710694c2bc48be94c91af63d02de4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:06Z,use_quota=True,user_id='2de3cb67e6e545368173fe74bc07cff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Creating volume 4b74dfbb-9b44-4b54-a635-bdb227ac8595 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:05 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 2147483648 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:05 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 2147483648 Jul 09 17:12:05 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:06 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9" returned: 0 in 1.192s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:06 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9 Jul 09 17:12:06 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:06 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD" returned: 0 in 1.157s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 is fetched for user 4a907df808614d5bb4dfcd7fb6bcb7b3. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d869d6-52c8-47fe-a789-7bce140d198b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:06 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD Jul 09 17:12:06 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:06 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8c9fa031-facd-4acc-815e-397c1df2b1a9" returned: 0 in 0.823s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Lock "cinder-quobyte-8c9fa031-facd-4acc-815e-397c1df2b1a9" released by "delete_volume" :: held 2.154s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:06 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['fb1352ee-395d-4ce4-a025-b1f48008cfb3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:07 devstack cinder-volume[86876]: WARNING cinder.quota [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-593793404 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-593793404, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:07 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 2147483648" returned: 0 in 1.236s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Created reservations ['60cbf3f7-18be-4af9-9a6b-c52eb2bd397f', 'c5b8f0b2-406e-47ab-9fea-fae27106437e', 'cb6bb3d0-9705-464e-993c-01d1b5e2efc3', 'ffd70e41-5a73-4143-bb1a-0245a895435a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:07 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 Jul 09 17:12:07 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:07 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:07 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:07 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:07 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595" returned: 0 in 0.835s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-100714531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf94c29-df13-4edd-8b01-f54a218d1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12d0bb41fa34125bcd451812395cb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:04Z,use_quota=True,user_id='4a907df808614d5bb4dfcd7fb6bcb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Creating volume fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:07 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:07 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1073741824 Jul 09 17:12:07 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baf016-f93a-4ccb-8e20-16c0fefc5a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595', 'volume_size': 2}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac4cb5a-4a5c-467b-99ca-ea8aca318d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:07 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Volume volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 (4b74dfbb-9b44-4b54-a635-bdb227ac8595): created successfully Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac4cb5a-4a5c-467b-99ca-ea8aca318d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Flow 'volume_create_manager' (93aff1b5-7992-4bbd-b1a8-b533d51202ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1eddcee0-4568-495a-aa12-5ef978266e1a tempest-VolumesCloneNegativeTest-1390530740 None] Created volume successfully. Jul 09 17:12:08 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.916s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:08 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-82c602f6-853b-4aec-828d-b59451d7c587 tempest-GroupSnapshotsTest-1390286325 None] Delete group completed successfully. Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Acquiring lock "cinder-4b74dfbb-9b44-4b54-a635-bdb227ac8595-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "cinder-4b74dfbb-9b44-4b54-a635-bdb227ac8595-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Acquiring lock "cinder-quobyte-4b74dfbb-9b44-4b54-a635-bdb227ac8595" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:09 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1073741824" returned: 0 in 1.376s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "cinder-quobyte-4b74dfbb-9b44-4b54-a635-bdb227ac8595" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf3ccd-e84f-4451-9014-9e34dc94606f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:09 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:09 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:09 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 Jul 09 17:12:09 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:10 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 0 in 1.213s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.740s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Attempting download of cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume fdf94c29-df13-4edd-8b01-f54a218d1f06. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[867cb0ee-a6f2-44a9-8e5d-2fc5d723fdf2]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:10 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j Jul 09 17:12:10 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:11 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595" returned: 0 in 1.625s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:11 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595 Jul 09 17:12:11 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:12 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j" returned: 0 in 1.328s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:12 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4b74dfbb-9b44-4b54-a635-bdb227ac8595" returned: 0 in 1.331s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "cinder-quobyte-4b74dfbb-9b44-4b54-a635-bdb227ac8595" released by "delete_volume" :: held 3.063s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Created reservations ['a158a7a0-af30-4dc9-8a8c-ff44e62afa96', 'c63fb896-603a-41ca-b718-33b7d0f8c6b3', 'b151f505-c2c6-4d77-b681-86cbbcf9f8f9', '9902acc8-1c0c-4fd5-bc50-2636e100a8d1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:12 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j Jul 09 17:12:12 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:12 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:12 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:13 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j" returned: 1 in 1.475s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_b029ab6j' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:12:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e0e6e-d147-4278-a07a-a07129854a05]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:13 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD Jul 09 17:12:13 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:14 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.611s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:14 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Deleted volume successfully. Jul 09 17:12:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92585af5-4743-421f-99f1-0166747a67f7 tempest-VolumesCloneNegativeTest-1390530740 None] Lock "cinder-4b74dfbb-9b44-4b54-a635-bdb227ac8595-delete_volume" released by "delete_volume" :: held 5.108s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:15 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD" returned: 0 in 1.487s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:15 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] cd66455c-9772-4d79-b400-0ea9cf463a75 was qcow2, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:12:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:15 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:15 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:17 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 0 in 2.796s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:17 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_hy3i8rwtdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:12:17 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Converted 112.00 MB image at 40.02 MB/s Jul 09 17:12:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:18 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1G Jul 09 17:12:18 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4ec8e9b3-6156-4066-ad71-fd6e63012800 tempest-GroupSnapshotsV319Test-820472240 None] Group tempest-GroupSnapshotsV319Test-Group-2030393338: creating Jul 09 17:12:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4ec8e9b3-6156-4066-ad71-fd6e63012800 tempest-GroupSnapshotsV319Test-820472240 None] Group tempest-GroupSnapshotsV319Test-Group-2030393338: created successfully Jul 09 17:12:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4ec8e9b3-6156-4066-ad71-fd6e63012800 tempest-GroupSnapshotsV319Test-820472240 None] Create group completed successfully. Jul 09 17:12:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Flow 'volume_create_manager' (1ae3928c-db2a-4b69-8552-18fa7102d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a06e27c-f563-4e2c-bf71-d05d59309278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:19 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 1G" returned: 0 in 1.113s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a06e27c-f563-4e2c-bf71-d05d59309278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-608377502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe644808-a1fb-4a9a-8625-3801347ebba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121342227434337afc6d8e3608030fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:19Z,use_quota=True,user_id='2dbaa2f0bba243e580dddf98d85b0277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e3179f-1d81-4cad-b9d7-a4d831ee1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e3179f-1d81-4cad-b9d7-a4d831ee1b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295d2bf-4043-40ff-a0d9-28f52441cf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295d2bf-4043-40ff-a0d9-28f52441cf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe644808-a1fb-4a9a-8625-3801347ebba3', 'volume_name': 'volume-fe644808-a1fb-4a9a-8625-3801347ebba3', 'volume_size': 2}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aa727a-0bad-48be-86c0-39d96c71e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aa727a-0bad-48be-86c0-39d96c71e732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca4ab6f-b604-4d47-b8a1-e8e8d5fd6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Volume fe644808-a1fb-4a9a-8625-3801347ebba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe644808-a1fb-4a9a-8625-3801347ebba3', 'volume_size': 2} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-608377502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe644808-a1fb-4a9a-8625-3801347ebba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121342227434337afc6d8e3608030fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:19Z,use_quota=True,user_id='2dbaa2f0bba243e580dddf98d85b0277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Creating volume fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 2147483648 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ce52c-9233-4730-808b-6f308edc3385]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:19 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 2147483648 Jul 09 17:12:19 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:19 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:19 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Flow 'volume_create_manager' (26083aab-32ad-4b87-b79a-e16f91d873b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7672eaeb-e8b0-47f2-90b9-f0ddac76f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7672eaeb-e8b0-47f2-90b9-f0ddac76f914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436353439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c15c5b8-405b-437f-b9e0-2712c7d1c71b,host='devstack@QuobyteHD#QuobyteHD',id=5d466704-fce8-432c-a3a1-fab10a355fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2d9240f7d741c2ac55a1306f967c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:20Z,use_quota=True,user_id='05118ef965824eaab80f69b1fdfd3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e650def-e224-4d71-b6fd-ccc38a406258),volume_type_id=1e650def-e224-4d71-b6fd-ccc38a406258)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb4f9d2-a2b7-4bb7-9e26-98b4fac1e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb4f9d2-a2b7-4bb7-9e26-98b4fac1e3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb51a98-408f-441a-89f8-7ee68e3a3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb51a98-408f-441a-89f8-7ee68e3a3732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d466704-fce8-432c-a3a1-fab10a355fbb', 'volume_name': 'volume-5d466704-fce8-432c-a3a1-fab10a355fbb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5af4b90-f7fc-41ca-82fe-2b8198736eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5af4b90-f7fc-41ca-82fe-2b8198736eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee7e5e6-82cc-4ca0-a4fa-fafc61884de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:20 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Volume 5d466704-fce8-432c-a3a1-fab10a355fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d466704-fce8-432c-a3a1-fab10a355fbb', 'volume_size': 1} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:20 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 0 in 1.453s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:20 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 2147483648" returned: 0 in 1.521s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:20 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 Jul 09 17:12:20 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:20 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:20 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:21 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3" returned: 0 in 0.680s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c15c5b8-405b-437f-b9e0-2712c7d1c71b,created_at=2026-07-09T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436353439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c15c5b8-405b-437f-b9e0-2712c7d1c71b,host='devstack@QuobyteHD#QuobyteHD',id=5d466704-fce8-432c-a3a1-fab10a355fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2d9240f7d741c2ac55a1306f967c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:20Z,use_quota=True,user_id='05118ef965824eaab80f69b1fdfd3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e650def-e224-4d71-b6fd-ccc38a406258),volume_type_id=1e650def-e224-4d71-b6fd-ccc38a406258)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Creating volume 5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:21 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:21 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca4ab6f-b604-4d47-b8a1-e8e8d5fd6307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe644808-a1fb-4a9a-8625-3801347ebba3', 'volume_size': 2}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb528444-1e31-4d27-9adf-9576149defee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:21 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb 1073741824 Jul 09 17:12:21 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 1 in 0.837s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Downloaded image cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume fdf94c29-df13-4edd-8b01-f54a218d1f06 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 for user 4a907df808614d5bb4dfcd7fb6bcb7b3 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Marking volume fdf94c29-df13-4edd-8b01-f54a218d1f06 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:12:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Volume volume-fe644808-a1fb-4a9a-8625-3801347ebba3 (fe644808-a1fb-4a9a-8625-3801347ebba3): created successfully Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb528444-1e31-4d27-9adf-9576149defee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Flow 'volume_create_manager' (1ae3928c-db2a-4b69-8552-18fa7102d62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Copying metadata from image cd66455c-9772-4d79-b400-0ea9cf463a75 to fdf94c29-df13-4edd-8b01-f54a218d1f06. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Creating volume glance metadata for volume fdf94c29-df13-4edd-8b01-f54a218d1f06 backed by image cd66455c-9772-4d79-b400-0ea9cf463a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:12:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5a8a25cd-3ceb-4a03-b925-dcbf7c994af7 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Created volume successfully. Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3146f1-1205-42d5-a162-5668e9902571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf94c29-df13-4edd-8b01-f54a218d1f06', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d9d7c6-b452-4ebc-b239-0c833ca9cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Volume volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 (fdf94c29-df13-4edd-8b01-f54a218d1f06): created successfully Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d9d7c6-b452-4ebc-b239-0c833ca9cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Flow 'volume_create_manager' (973d66a2-24a8-450a-82bb-e69f8b7c1d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3878c4f0-2e1c-4013-bcea-d7b9897af8dd tempest-VolumesImageMetadata-42169948 None] Created volume successfully. Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Acquiring lock "cinder-fdf94c29-df13-4edd-8b01-f54a218d1f06-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "cinder-fdf94c29-df13-4edd-8b01-f54a218d1f06-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:22 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb 1073741824" returned: 0 in 1.101s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Acquiring lock "cinder-quobyte-fdf94c29-df13-4edd-8b01-f54a218d1f06" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "cinder-quobyte-fdf94c29-df13-4edd-8b01-f54a218d1f06" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6bd47-397c-47b0-a9ad-bde5f37a381a]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:22 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb Jul 09 17:12:22 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:22 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:22 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:23 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb" returned: 0 in 0.796s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.867s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee7e5e6-82cc-4ca0-a4fa-fafc61884de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d466704-fce8-432c-a3a1-fab10a355fbb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f78eb59-ff1f-468d-8e54-fad2e30c7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Creating offline snapshot 86aefc2f-3f94-4799-b256-adda5918bb93 of volume fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:12:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Volume volume-5d466704-fce8-432c-a3a1-fab10a355fbb (5d466704-fce8-432c-a3a1-fab10a355fbb): created successfully Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f78eb59-ff1f-468d-8e54-fad2e30c7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Flow 'volume_create_manager' (26083aab-32ad-4b87-b79a-e16f91d873b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[554bfa87-899f-4110-90d4-6e870a0d560d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3e6403bd-7675-4463-bded-5b7d74099e9b tempest-GroupSnapshotsV319Test-820472240 None] Created volume successfully. Jul 09 17:12:23 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 0 in 0.930s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:23 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 Jul 09 17:12:23 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:23 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:23 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:24 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] GroupSnapshot 626e8078-a343-43b7-904d-c42329d729a1: creating. Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3" returned: 0 in 0.952s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 2G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Group snapshot 626e8078-a343-43b7-904d-c42329d729a1: creating. {{(pid=86876) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 17:12:24 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 2G Jul 09 17:12:24 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:24 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 1 in 0.965s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:12:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:24 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06 Jul 09 17:12:24 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:25 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fdf94c29-df13-4edd-8b01-f54a218d1f06" returned: 0 in 0.678s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "cinder-quobyte-fdf94c29-df13-4edd-8b01-f54a218d1f06" released by "delete_volume" :: held 2.640s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Created reservations ['1f4875c4-2fea-4bd8-8eeb-c7d157b2bb5a', '99a17912-af28-4a96-8fc4-fd1bcd812a35', '0f23ce17-47d0-4d64-99d5-54ff79fff5fc', '036f88e1-0761-4311-a586-73b0c940318b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:25 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 2G" returned: 0 in 0.846s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe644808-a1fb-4a9a-8625-3801347ebba3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:25 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe644808-a1fb-4a9a-8625-3801347ebba3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 Jul 09 17:12:25 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:25 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:25 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:25 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.660s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:26 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:26 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Deleted volume successfully. Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe644808-a1fb-4a9a-8625-3801347ebba3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:26 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 is being set with open permissions: ugo+rw Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:26 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 Jul 09 17:12:26 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c1b23fa-551c-433a-8233-d1b904d2928c tempest-VolumesImageMetadata-42169948 None] Lock "cinder-fdf94c29-df13-4edd-8b01-f54a218d1f06-delete_volume" released by "delete_volume" :: held 3.621s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:26 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:26 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info Jul 09 17:12:26 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:27 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:27 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info is being set with open permissions: ugo+rw Jul 09 17:12:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:27 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info Jul 09 17:12:27 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:28 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.info" returned: 0 in 0.651s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.682s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.589s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Creating offline snapshot 15532957-41f9-4b86-b2db-e2eb85e7d16c of volume 5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[62034f69-36dd-4958-9f32-7b310c4f860a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-21ff9d79-ab8e-47d0-9f0a-a7b65db6c294 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Create snapshot completed successfully Jul 09 17:12:28 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb Jul 09 17:12:28 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Flow 'volume_create_manager' (84a2a95d-7977-444f-85a3-ef4166931c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e321fa9-55dd-49e4-9ad5-0883d8efcad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e321fa9-55dd-49e4-9ad5-0883d8efcad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-34149286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb37168c-ccba-4ea1-801c-b8da851b3581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8968eeb75f45668a9ffd9248d72e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:29Z,use_quota=True,user_id='2f446ad2888746a19dae5892345569ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6fbbb5-17fc-46ba-8141-9c24bd9fa2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6fbbb5-17fc-46ba-8141-9c24bd9fa2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c50790-8ee8-427d-8cf1-b3e0150c368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c50790-8ee8-427d-8cf1-b3e0150c368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb37168c-ccba-4ea1-801c-b8da851b3581', 'volume_name': 'volume-eb37168c-ccba-4ea1-801c-b8da851b3581', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059ac94-df67-4feb-a351-739ea159514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059ac94-df67-4feb-a351-739ea159514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb13975-7971-4533-853c-6a2a3814c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Volume eb37168c-ccba-4ea1-801c-b8da851b3581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb37168c-ccba-4ea1-801c-b8da851b3581', 'volume_size': 1} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "cinder-86aefc2f-3f94-4799-b256-adda5918bb93-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-86aefc2f-3f94-4799-b256-adda5918bb93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "cinder-quobyte-86aefc2f-3f94-4799-b256-adda5918bb93" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-86aefc2f-3f94-4799-b256-adda5918bb93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Deleting offline snapshot 86aefc2f-3f94-4799-b256-adda5918bb93 of volume fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] snapshot_file for this snap is: volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:12:28 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed1d15-5bac-43ab-8955-9d235844029d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:28 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c 1G Jul 09 17:12:28 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:29 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 Jul 09 17:12:29 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:29 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93" returned: 0 in 0.783s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe644808-a1fb-4a9a-8625-3801347ebba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027efcf-8ff2-4258-9335-17e379965a63]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:29 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c 1G" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d466704-fce8-432c-a3a1-fab10a355fbb -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:29 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d466704-fce8-432c-a3a1-fab10a355fbb -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c Jul 09 17:12:29 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 Jul 09 17:12:29 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:29 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:30 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d466704-fce8-432c-a3a1-fab10a355fbb -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:30 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:12:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:30 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3" returned: 0 in 0.818s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:30 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c Jul 09 17:12:30 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:30 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 Jul 09 17:12:30 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:31 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c" returned: 0 in 0.730s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:31 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info Jul 09 17:12:31 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:31 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93" returned: 0 in 0.889s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:31 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93 Jul 09 17:12:31 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:32 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info" returned: 0 in 0.721s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:32 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:32 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info Jul 09 17:12:32 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:32 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3.86aefc2f-3f94-4799-b256-adda5918bb93" returned: 0 in 0.744s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=90,cinder:SELECT=93,cinder:DELETE=6,cinder:INSERT=27 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=89,cinder:INSERT=33,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-86aefc2f-3f94-4799-b256-adda5918bb93" released by "_delete_snapshot" :: held 3.366s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" released by "delete_snapshot" :: held 3.398s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Created reservations ['daf21168-7a2f-4399-adc9-3d6a000ac00c', 'd42b57d1-8e76-446f-ab54-b289f3ac91fd', 'f9f04ce0-5dcc-4383-a281-a3a805f234bd', 'e4b50d45-3195-4832-a5b8-8a657957f2c8'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Delete snapshot completed successfully. Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21d8f99d-0dca-456a-a0f0-5fec4e08ac36 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-86aefc2f-3f94-4799-b256-adda5918bb93-delete_snapshot" released by "delete_snapshot" :: held 3.575s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:32 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.info" returned: 0 in 0.736s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.746s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-34149286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb37168c-ccba-4ea1-801c-b8da851b3581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8968eeb75f45668a9ffd9248d72e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:29Z,use_quota=True,user_id='2f446ad2888746a19dae5892345569ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Creating volume eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:32 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:32 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 1073741824 Jul 09 17:12:32 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1975999a-f321-4151-8080-e8e079b294c9 tempest-GroupSnapshotsV319Test-820472240 None] group_snapshot 626e8078-a343-43b7-904d-c42329d729a1: created successfully Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "cinder-fe644808-a1fb-4a9a-8625-3801347ebba3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-fe644808-a1fb-4a9a-8625-3801347ebba3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e795d1-9cf2-4bbd-8f89-8cef090d1999]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:33 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 Jul 09 17:12:33 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:33 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 1073741824" returned: 0 in 0.958s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:33 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 Jul 09 17:12:33 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] group_snapshot 626e8078-a343-43b7-904d-c42329d729a1: deleting Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] group_snapshot 626e8078-a343-43b7-904d-c42329d729a1: deleting {{(pid=86876) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 17:12:34 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3" returned: 0 in 0.889s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:34 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3 Jul 09 17:12:34 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "cinder-quobyte-15532957-41f9-4b86-b2db-e2eb85e7d16c" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-15532957-41f9-4b86-b2db-e2eb85e7d16c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Deleting offline snapshot 15532957-41f9-4b86-b2db-e2eb85e7d16c of volume 5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] snapshot_file for this snap is: volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:12:34 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581" returned: 0 in 0.761s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbceaa79-1334-4d21-a7f8-ebe02eb6613e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb13975-7971-4533-853c-6a2a3814c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb37168c-ccba-4ea1-801c-b8da851b3581', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97e8a70-3186-4429-9b6f-96997c69a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:34 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Volume volume-eb37168c-ccba-4ea1-801c-b8da851b3581 (eb37168c-ccba-4ea1-801c-b8da851b3581): created successfully Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97e8a70-3186-4429-9b6f-96997c69a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Flow 'volume_create_manager' (84a2a95d-7977-444f-85a3-ef4166931c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e68b240e-a228-4d1f-95d1-09abbe52f2f9 tempest-SnapshotMetadataTestJSON-90025061 None] Created volume successfully. Jul 09 17:12:34 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c Jul 09 17:12:34 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:35 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-fe644808-a1fb-4a9a-8625-3801347ebba3" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-quobyte-fe644808-a1fb-4a9a-8625-3801347ebba3" released by "delete_volume" :: held 1.860s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Creating offline snapshot aa52b7d2-31eb-4326-8a75-c1103a860812 of volume eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5911467d-274f-4444-8f56-9d5296835033]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Created reservations ['833d22c2-3000-4897-bbb7-7f07515b79c6', '02ce6f76-8eef-47ed-8d63-e380db5c9af2', '92ee9b4a-a1fd-4c79-b140-4b6dc11fcacd', '1212e5a0-35f2-4fdd-bc08-2f143ec67107'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:35 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 Jul 09 17:12:35 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:35 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:35 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:35 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c" returned: 0 in 1.065s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d466704-fce8-432c-a3a1-fab10a355fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948c605-d311-439c-bc68-757f4bd56ecc]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:35 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb Jul 09 17:12:35 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:36 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.700s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Deleted volume successfully. Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4f99e175-dd92-4323-973f-ac3941395de5 tempest-VolumesSnapshotNegativeTestJSON-1157170351 None] Lock "cinder-fe644808-a1fb-4a9a-8625-3801347ebba3-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:36 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581" returned: 0 in 0.884s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:36 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 1G Jul 09 17:12:36 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:36 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb" returned: 0 in 0.827s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:36 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c Jul 09 17:12:36 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:37 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 1G" returned: 0 in 1.017s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb37168c-ccba-4ea1-801c-b8da851b3581 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:37 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb37168c-ccba-4ea1-801c-b8da851b3581 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 Jul 09 17:12:37 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:37 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c" returned: 0 in 0.971s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:37 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c Jul 09 17:12:37 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:38 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb37168c-ccba-4ea1-801c-b8da851b3581 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812" returned: 0 in 0.883s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:38 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 is being set with open permissions: ugo+rw Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:38 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 Jul 09 17:12:38 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:38 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb.15532957-41f9-4b86-b2db-e2eb85e7d16c" returned: 0 in 0.859s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-15532957-41f9-4b86-b2db-e2eb85e7d16c" released by "_delete_snapshot" :: held 3.873s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" released by "delete_snapshot" :: held 3.906s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:38 devstack cinder-volume[86876]: WARNING cinder.quota [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428902482 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428902482, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:38 devstack cinder-volume[86876]: WARNING cinder.quota [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428902482 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428902482, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] Created reservations ['2c4049dd-1754-474f-9bc9-99eaee1316be', '390f1f05-3b48-45ae-931b-7dd57a660074', '575ad130-b823-470d-9853-7d4c0f985d8f', '836d6b46-2ef6-4282-a06f-e935a5f13c68'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9796db0f-ce32-48b2-bb8b-081a6193ce08 tempest-GroupSnapshotsV319Test-820472240 None] group_snapshot 626e8078-a343-43b7-904d-c42329d729a1: deleted successfully Jul 09 17:12:39 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812" returned: 0 in 0.768s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:39 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info Jul 09 17:12:39 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c04b6-0f4d-4f0b-abc4-5e1d1d51d863]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:39 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb Jul 09 17:12:39 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:40 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info" returned: 0 in 0.989s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:40 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info is being set with open permissions: ugo+rw Jul 09 17:12:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:40 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info Jul 09 17:12:40 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:40 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb" returned: 0 in 1.017s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:40 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb Jul 09 17:12:40 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:41 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.info" returned: 0 in 1.106s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.765s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-93cf950c-6faa-4061-a6ba-fa82298bac6f tempest-SnapshotMetadataTestJSON-90025061 None] Create snapshot completed successfully Jul 09 17:12:41 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5d466704-fce8-432c-a3a1-fab10a355fbb" returned: 0 in 0.976s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Lock "cinder-quobyte-5d466704-fce8-432c-a3a1-fab10a355fbb" released by "delete_volume" :: held 2.098s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Created reservations ['dd9a0fa0-082d-45e9-af0d-8d57136a22cb'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:41 devstack cinder-volume[86876]: WARNING cinder.quota [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1428902482 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1428902482, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Created reservations ['c2303549-0b56-49ac-bd7f-0c1b65e2d842', '223260f8-41e7-44c3-b46f-75d90d69b1f3', '2f275d41-05f9-448b-8f62-945f1a3dd2f8', '0bc46765-8012-4fbd-abfb-98287870d2d3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:41 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:41 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-db68a874-6058-4a72-aba3-cadfd2b42943 req-38f1d6f0-d42c-4057-b866-e71ca86566b2 tempest-TestShelveInstance-906958860 None] Terminate volume connection completed successfully. Jul 09 17:12:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-db68a874-6058-4a72-aba3-cadfd2b42943 req-38f1d6f0-d42c-4057-b866-e71ca86566b2 tempest-TestShelveInstance-906958860 None] Deleting attachment e3175039-51cd-4fca-a452-518121b1eeb2. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:12:42 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.929s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-83319320-a746-45a8-a234-1bd1aa1f6506 tempest-GroupSnapshotsV319Test-820472240 None] Delete group completed successfully. Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "cinder-aa52b7d2-31eb-4326-8a75-c1103a860812-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-aa52b7d2-31eb-4326-8a75-c1103a860812-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "cinder-quobyte-aa52b7d2-31eb-4326-8a75-c1103a860812" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-aa52b7d2-31eb-4326-8a75-c1103a860812" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Deleting offline snapshot aa52b7d2-31eb-4326-8a75-c1103a860812 of volume eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:12:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] snapshot_file for this snap is: volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:12:43 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b55469-0032-42d0-a2ab-390932d7f042]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:43 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 Jul 09 17:12:43 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:44 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812" returned: 0 in 0.944s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb37168c-ccba-4ea1-801c-b8da851b3581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:12:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[10980520-adcd-48e5-a338-a76371843345]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:44 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 Jul 09 17:12:44 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:45 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581" returned: 0 in 1.023s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:45 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 Jul 09 17:12:45 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:46 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812" returned: 0 in 1.082s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:46 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812 Jul 09 17:12:46 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:46 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581.aa52b7d2-31eb-4326-8a75-c1103a860812" returned: 0 in 0.815s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-aa52b7d2-31eb-4326-8a75-c1103a860812" released by "_delete_snapshot" :: held 4.054s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" released by "delete_snapshot" :: held 4.083s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:47 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Created reservations ['93335dc5-70f9-4c34-ad5b-148eac48bfdd', 'b8d15626-b221-47b1-86a5-5472fd23e4d5', '35e6909d-c42c-41b3-aee4-277417d46c40', 'c2fe4c8f-ccd8-4507-a49f-4398079b82f6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Delete snapshot completed successfully. Jul 09 17:12:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-10252ba0-594a-4be5-b33c-0bcc700fc79e tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-aa52b7d2-31eb-4326-8a75-c1103a860812-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "cinder-eb37168c-ccba-4ea1-801c-b8da851b3581-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-eb37168c-ccba-4ea1-801c-b8da851b3581-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[896dae7d-49b5-4181-b2f3-c51d5e156636]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:48 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 Jul 09 17:12:48 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:49 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581" returned: 0 in 1.130s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:49 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581 Jul 09 17:12:49 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:50 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-eb37168c-ccba-4ea1-801c-b8da851b3581" returned: 0 in 0.864s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-quobyte-eb37168c-ccba-4ea1-801c-b8da851b3581" released by "delete_volume" :: held 2.111s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Created reservations ['e2eb11ff-1df4-4757-9acd-f48fdd0da491', 'fa81fc85-1233-441f-82dd-a1c930c272db', '7b246356-34bf-46f4-866a-7cd45cd87840', 'f2b5ea20-8a8f-467a-b647-4e2d77d2efeb'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bdb2dc-77c5-45b0-8d50-42e5d00550cb]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:50 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:12:50 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:51 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:12:51 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:51 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.931s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:51 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:12:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Deleted volume successfully. Jul 09 17:12:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-494849a2-14bb-4e37-9cb1-d0fb404bea39 tempest-SnapshotMetadataTestJSON-90025061 None] Lock "cinder-eb37168c-ccba-4ea1-801c-b8da851b3581-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:12:52 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 1.382s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:52 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:12:52 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:53 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 1 in 0.985s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:12:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.430s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f13a9985-0e51-4cfe-9237-7a894bd3044d', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:12:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-03067dec-8e4f-4f71-ad8b-2bae0925b6d7 req-0f399784-9de1-444c-b8f9-4b2766311a80 tempest-TestShelveInstance-906958860 None] attachment_update completed successfully. Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Flow 'volume_create_manager' (cba4e5b2-eec2-436e-86cd-3e5ac3453fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93908711-0918-4be5-a7ed-c996a74fdac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93908711-0918-4be5-a7ed-c996a74fdac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-68023480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67534798-40dd-4a51-816d-06a6d9c032e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4988151a4e45e48a5d966044947b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:56Z,use_quota=True,user_id='49da1dbcffe14dd2958fdad1e9ee820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c520b8-e38c-4f98-869a-29d77b3e6ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c520b8-e38c-4f98-869a-29d77b3e6ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604c09b9-58ec-4d08-9a35-4f6c9d399d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604c09b9-58ec-4d08-9a35-4f6c9d399d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67534798-40dd-4a51-816d-06a6d9c032e2', 'volume_name': 'volume-67534798-40dd-4a51-816d-06a6d9c032e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6472ba65-2062-46de-9b60-8886e6f7a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6472ba65-2062-46de-9b60-8886e6f7a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8143a4a8-246c-4183-98b8-31df33fa33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Volume 67534798-40dd-4a51-816d-06a6d9c032e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67534798-40dd-4a51-816d-06a6d9c032e2', 'volume_size': 1} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-68023480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67534798-40dd-4a51-816d-06a6d9c032e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4988151a4e45e48a5d966044947b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:56Z,use_quota=True,user_id='49da1dbcffe14dd2958fdad1e9ee820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Creating volume 67534798-40dd-4a51-816d-06a6d9c032e2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:55 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:55 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 1073741824 Jul 09 17:12:55 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:56 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 1073741824" returned: 0 in 0.971s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:56 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 Jul 09 17:12:56 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:57 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2" returned: 0 in 0.762s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8143a4a8-246c-4183-98b8-31df33fa33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67534798-40dd-4a51-816d-06a6d9c032e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bcde28-0572-4886-9b79-8c25da9bd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:57 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Volume volume-67534798-40dd-4a51-816d-06a6d9c032e2 (67534798-40dd-4a51-816d-06a6d9c032e2): created successfully Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bcde28-0572-4886-9b79-8c25da9bd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Flow 'volume_create_manager' (cba4e5b2-eec2-436e-86cd-3e5ac3453fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bea04c44-00b6-414f-a84f-443f2476e378 tempest-VolumesMetadataTest-26174571 None] Created volume successfully. Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Flow 'volume_create_manager' (fe079c28-2dcb-450c-b0fe-517aa7d41fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d68327-0ffd-4183-a833-a96ea1284d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d68327-0ffd-4183-a833-a96ea1284d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-298299097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0655629b-44d6-4e4a-a2aa-2a0cfff44b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b937c5d271a4f3e954ba47e80ecff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:59Z,use_quota=True,user_id='fbdfda41d53e4b33bba2c20a2ad158f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12853e0e-849e-4feb-a574-f776f1d16169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12853e0e-849e-4feb-a574-f776f1d16169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b9819a-1ba1-461b-a2f8-e53b7e7d4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b9819a-1ba1-461b-a2f8-e53b7e7d4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0655629b-44d6-4e4a-a2aa-2a0cfff44b48', 'volume_name': 'volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88ef42a-115e-4c53-8d74-a0e28fd4423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88ef42a-115e-4c53-8d74-a0e28fd4423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fc534a-8d41-486b-8482-2ae6f706d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:12:58 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48', 'volume_size': 1} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-298299097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0655629b-44d6-4e4a-a2aa-2a0cfff44b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b937c5d271a4f3e954ba47e80ecff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:12:59Z,use_quota=True,user_id='fbdfda41d53e4b33bba2c20a2ad158f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Creating volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:12:58 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:58 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 1073741824 Jul 09 17:12:58 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Acquiring lock "cinder-67534798-40dd-4a51-816d-06a6d9c032e2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "cinder-67534798-40dd-4a51-816d-06a6d9c032e2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Acquiring lock "cinder-quobyte-67534798-40dd-4a51-816d-06a6d9c032e2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:12:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "cinder-quobyte-67534798-40dd-4a51-816d-06a6d9c032e2" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:12:59 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd1102-d0c5-436a-9b82-e5d619093b46]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:12:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:12:59 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 Jul 09 17:12:59 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:00 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 1073741824" returned: 0 in 1.394s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:00 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2" returned: 0 in 1.223s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:00 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:00 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:00 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2 Jul 09 17:13:00 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:00 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:00 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:01 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" returned: 0 in 0.881s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fc534a-8d41-486b-8482-2ae6f706d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a4e260-2327-4d75-8c5d-2608dc46afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:01 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Volume volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 (0655629b-44d6-4e4a-a2aa-2a0cfff44b48): created successfully Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a4e260-2327-4d75-8c5d-2608dc46afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Flow 'volume_create_manager' (fe079c28-2dcb-450c-b0fe-517aa7d41fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-52d85cae-c144-461b-bc90-288a1f4c3d91 tempest-SnapshotsActionsTest-1258428 None] Created volume successfully. Jul 09 17:13:01 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-67534798-40dd-4a51-816d-06a6d9c032e2" returned: 0 in 1.043s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "cinder-quobyte-67534798-40dd-4a51-816d-06a6d9c032e2" released by "delete_volume" :: held 2.328s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Created reservations ['79c22ffb-b244-4a4c-8295-b36e07810379', '850e4d87-f435-40c4-8467-9a0d57e719cd', '9426d867-8c83-4a94-8886-9a32e57a9a5e', '35b53654-f1fb-4fd3-ba9b-c50474810e09'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:01 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.009s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 28 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:13:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:13:01 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:01 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Creating offline snapshot 51f070cb-c003-4b13-812a-74ce1ebc1775 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e792c936-04c5-4988-b4f3-6e11029b1626]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:02 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 Jul 09 17:13:02 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:02 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.998s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:02 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Deleted volume successfully. Jul 09 17:13:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ba7c36af-a17d-44a8-b156-ae5fb9691912 tempest-VolumesMetadataTest-26174571 None] Lock "cinder-67534798-40dd-4a51-816d-06a6d9c032e2-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:03 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" returned: 0 in 1.154s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:03 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 1G Jul 09 17:13:03 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:04 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 1G" returned: 0 in 1.129s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:04 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:04 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:05 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.992s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:05 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 is being set with open permissions: ugo+rw Jul 09 17:13:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:05 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:05 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:06 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.252s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:06 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info Jul 09 17:13:06 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:07 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info" returned: 0 in 0.939s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:07 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info is being set with open permissions: ugo+rw Jul 09 17:13:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:07 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info Jul 09 17:13:07 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:08 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.info" returned: 0 in 0.980s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.598s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3fccb081-be6d-4624-9ef0-f8be25418424 tempest-SnapshotsActionsTest-1258428 None] Create snapshot completed successfully Jul 09 17:13:09 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (5ad3568f-7111-480e-aa24-1b6cab560692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef92dc9-7752-4bcf-88a7-b4c9ea54685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef92dc9-7752-4bcf-88a7-b4c9ea54685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1457837999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553002a3-6f8b-425d-b7ec-792447decb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:10Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1882a32-dd14-40ac-a884-f6bb15354cb2),volume_type_id=e1882a32-dd14-40ac-a884-f6bb15354cb2)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eae840-d51b-45a0-9964-81fe772ae3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eae840-d51b-45a0-9964-81fe772ae3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48a548-9666-49ec-9b54-525d3e7eb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48a548-9666-49ec-9b54-525d3e7eb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553002a3-6f8b-425d-b7ec-792447decb66', 'volume_name': 'volume-553002a3-6f8b-425d-b7ec-792447decb66', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7966b8e-05f5-4927-8601-bbc027db8d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7966b8e-05f5-4927-8601-bbc027db8d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85db626b-3bec-4c24-b88b-78bd2e2a9ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume 553002a3-6f8b-425d-b7ec-792447decb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553002a3-6f8b-425d-b7ec-792447decb66', 'volume_size': 1} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1457837999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553002a3-6f8b-425d-b7ec-792447decb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:10Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1882a32-dd14-40ac-a884-f6bb15354cb2),volume_type_id=e1882a32-dd14-40ac-a884-f6bb15354cb2)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Creating volume 553002a3-6f8b-425d-b7ec-792447decb66 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:10 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:10 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 1073741824 Jul 09 17:13:10 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (a7a809d6-ac6c-4f50-9ef9-b0f0a0561ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731f081f-74ac-4fa4-916f-c66593ea516b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731f081f-74ac-4fa4-916f-c66593ea516b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1347546882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10dd552-ca63-4342-a4bc-4927e3b09979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:10Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2511a1d-1195-4c10-822b-e6201edb7a3c),volume_type_id=e2511a1d-1195-4c10-822b-e6201edb7a3c)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4a2718-19d0-4191-a379-c6e8a8c60d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4a2718-19d0-4191-a379-c6e8a8c60d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585862b5-4eee-4243-9eb3-c4ced31a9818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585862b5-4eee-4243-9eb3-c4ced31a9818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10dd552-ca63-4342-a4bc-4927e3b09979', 'volume_name': 'volume-e10dd552-ca63-4342-a4bc-4927e3b09979', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453d0ccb-a927-4560-8602-79d911cfdc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453d0ccb-a927-4560-8602-79d911cfdc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56837a-a4e2-4325-9994-11d538e8e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume e10dd552-ca63-4342-a4bc-4927e3b09979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10dd552-ca63-4342-a4bc-4927e3b09979', 'volume_size': 1} Jul 09 17:13:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Flow 'volume_create_manager' (db0b25a1-e9d2-4779-a2d9-c18913215a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17ac5f9-168b-40b2-ab94-2ea2fb67ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17ac5f9-168b-40b2-ab94-2ea2fb67ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1181358369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ecedb8-4847-4c72-b60c-f5dd93247c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2123fc9b0bba45378b9a67255ebd0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:11Z,use_quota=True,user_id='2be2e088982a4a9e827930b279b79666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215d1111-90b2-49c5-a187-91cf3757fe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215d1111-90b2-49c5-a187-91cf3757fe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9a1b0-5ec4-471d-9a05-86a3c0a31fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9a1b0-5ec4-471d-9a05-86a3c0a31fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ecedb8-4847-4c72-b60c-f5dd93247c0d', 'volume_name': 'volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9bb2a5-a313-439a-a67c-e2176b2702ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9bb2a5-a313-439a-a67c-e2176b2702ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c24b482-2da2-4dc5-a061-12ea6ee62d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Volume 09ecedb8-4847-4c72-b60c-f5dd93247c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d', 'volume_size': 1} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (a5372568-4a4d-4c11-9d1d-7cedff4e9aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d567b-eb47-4ce7-b1bf-f21730a3b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d567b-eb47-4ce7-b1bf-f21730a3b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156191337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba1a04-1c45-4739-8b86-58aef6a115d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:12Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b62b08-2dc5-4fa2-8b91-e43317fa6ec9),volume_type_id=f8b62b08-2dc5-4fa2-8b91-e43317fa6ec9)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307e165a-d777-4600-9cac-a0b745633424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307e165a-d777-4600-9cac-a0b745633424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e69c332-e821-45ea-b805-13b78c4f8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:11 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 1073741824" returned: 0 in 1.885s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:12 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 Jul 09 17:13:12 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e69c332-e821-45ea-b805-13b78c4f8739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99ba1a04-1c45-4739-8b86-58aef6a115d4', 'volume_name': 'volume-99ba1a04-1c45-4739-8b86-58aef6a115d4', 'volume_size': 1, 'image_id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1063340979', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4f24355d6a3452cbeef841efc4e3a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'created_at': datetime.datetime(2026, 7, 9, 15, 13, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cf81ded-5878-484c-9c40-885d0ef8b171/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9907f821-d8a1-4d43-9fb4-a0847812337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9907f821-d8a1-4d43-9fb4-a0847812337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840d5ab9-2828-4637-8731-a0960e6748f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume 99ba1a04-1c45-4739-8b86-58aef6a115d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99ba1a04-1c45-4739-8b86-58aef6a115d4', 'volume_size': 1, 'image_id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1063340979', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4f24355d6a3452cbeef841efc4e3a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'created_at': datetime.datetime(2026, 7, 9, 15, 13, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cf81ded-5878-484c-9c40-885d0ef8b171/file', 'properties': {}}, 'image_service': } Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Trying to clone 99ba1a04-1c45-4739-8b86-58aef6a115d4 from image 5cf81ded-5878-484c-9c40-885d0ef8b171 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:13:12 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] <== create_volume: return (2758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.761s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.914s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1347546882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10dd552-ca63-4342-a4bc-4927e3b09979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:10Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2511a1d-1195-4c10-822b-e6201edb7a3c),volume_type_id=e2511a1d-1195-4c10-822b-e6201edb7a3c)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Creating volume e10dd552-ca63-4342-a4bc-4927e3b09979 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:12 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 1073741824 Jul 09 17:13:12 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85db626b-3bec-4c24-b88b-78bd2e2a9ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553002a3-6f8b-425d-b7ec-792447decb66', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3a6047-32de-4317-8960-147c07f4aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume volume-553002a3-6f8b-425d-b7ec-792447decb66 (553002a3-6f8b-425d-b7ec-792447decb66): created successfully Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3a6047-32de-4317-8960-147c07f4aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (5ad3568f-7111-480e-aa24-1b6cab560692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5bffba17-9fef-4ece-939a-0c4dd88a95a8 tempest-TestInstancesWithCinderVolumes-1248001463 None] Created volume successfully. Jul 09 17:13:13 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 1073741824" returned: 0 in 1.031s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:13 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 Jul 09 17:13:13 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:14 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979" returned: 0 in 0.672s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.396s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1181358369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ecedb8-4847-4c72-b60c-f5dd93247c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2123fc9b0bba45378b9a67255ebd0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:11Z,use_quota=True,user_id='2be2e088982a4a9e827930b279b79666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Creating volume 09ecedb8-4847-4c72-b60c-f5dd93247c0d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:14 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56837a-a4e2-4325-9994-11d538e8e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10dd552-ca63-4342-a4bc-4927e3b09979', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:14 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d 1073741824 Jul 09 17:13:14 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb983d-6833-45f5-a456-710b1a5d4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume volume-e10dd552-ca63-4342-a4bc-4927e3b09979 (e10dd552-ca63-4342-a4bc-4927e3b09979): created successfully Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb983d-6833-45f5-a456-710b1a5d4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (a7a809d6-ac6c-4f50-9ef9-b0f0a0561ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e806ef8c-27e5-42e3-9773-2f769e87ab77 tempest-TestInstancesWithCinderVolumes-1248001463 None] Created volume successfully. Jul 09 17:13:15 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d 1073741824" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:15 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d Jul 09 17:13:15 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:15 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD, size 20.69 MB, duration 3.45 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:13:15 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Image download 20.69 MB at 5.99 MB/s Jul 09 17:13:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8f551-35bd-47f2-a78c-a5311c1e27ad]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:16 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD Jul 09 17:13:16 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:16 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d" returned: 0 in 0.688s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.403s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c24b482-2da2-4dc5-a061-12ea6ee62d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ec519a-440c-4a6e-ab77-23845d976daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Creating offline snapshot f62728c8-bec9-4c65-a694-168744eb04ea of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:13:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Volume volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d (09ecedb8-4847-4c72-b60c-f5dd93247c0d): created successfully Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ec519a-440c-4a6e-ab77-23845d976daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Flow 'volume_create_manager' (db0b25a1-e9d2-4779-a2d9-c18913215a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c8c8f-7fbd-4c2b-8b48-23cd38f92a6b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3e83a766-cc64-4558-9b7d-c541a8778e0d tempest-VolumesTransfersV355Test-286844778 None] Created volume successfully. Jul 09 17:13:16 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:16 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:16 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Temporary image 5cf81ded-5878-484c-9c40-885d0ef8b171 is fetched for user ba411de50c2244aa84f051baf4f13367. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfbe12e-0833-45ed-9608-0b54ad666d57]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:16 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD Jul 09 17:13:16 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:17 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:17 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea 1G Jul 09 17:13:17 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:17 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:18 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea 1G" returned: 0 in 0.948s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:18 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea Jul 09 17:13:18 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2dba05eb-1079-4efa-9bf8-64f15dcd7bd4 tempest-VolumesTransfersV355Test-437047562 None] Transfer volume completed successfully. Jul 09 17:13:18 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea" returned: 0 in 0.769s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:18 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea is being set with open permissions: ugo+rw Jul 09 17:13:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:18 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea Jul 09 17:13:18 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "cinder-09ecedb8-4847-4c72-b60c-f5dd93247c0d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-09ecedb8-4847-4c72-b60c-f5dd93247c0d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "cinder-quobyte-09ecedb8-4847-4c72-b60c-f5dd93247c0d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-quobyte-09ecedb8-4847-4c72-b60c-f5dd93247c0d" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee196132-318b-4693-b490-cdc961fead8f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:19 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d Jul 09 17:13:19 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:19 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea" returned: 0 in 0.688s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1156191337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba1a04-1c45-4739-8b86-58aef6a115d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24355d6a3452cbeef841efc4e3a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:12Z,use_quota=True,user_id='ba411de50c2244aa84f051baf4f13367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b62b08-2dc5-4fa2-8b91-e43317fa6ec9),volume_type_id=f8b62b08-2dc5-4fa2-8b91-e43317fa6ec9)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Creating volume 99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:19 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1073741824 Jul 09 17:13:19 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4b4e72e6-f1bb-49a1-bc73-a5c4ee9398ae tempest-SnapshotsActionsTest-1258428 None] Create snapshot completed successfully Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-f62728c8-bec9-4c65-a694-168744eb04ea-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-f62728c8-bec9-4c65-a694-168744eb04ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-f62728c8-bec9-4c65-a694-168744eb04ea" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-f62728c8-bec9-4c65-a694-168744eb04ea" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:20 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Deleting offline snapshot f62728c8-bec9-4c65-a694-168744eb04ea of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] snapshot_file for this snap is: volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d" returned: 0 in 0.955s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e934e563-30eb-4c6e-af55-9f1393eb7ba2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:20 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d Jul 09 17:13:20 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:20 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea Jul 09 17:13:20 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:20 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1073741824" returned: 0 in 1.004s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:20 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:20 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:21 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-09ecedb8-4847-4c72-b60c-f5dd93247c0d" returned: 0 in 0.766s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-quobyte-09ecedb8-4847-4c72-b60c-f5dd93247c0d" released by "delete_volume" :: held 1.766s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Created reservations ['d88b9093-139c-402c-9422-3e04b7f204e7', 'bd3420ca-950c-497f-8f0b-29b313e483ab', '93e2ba95-ea45-4084-bd89-2132872c2f8f', '7df8e146-0cf3-49a6-8f68-e9f4687fdf52'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:21 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea" returned: 0 in 0.935s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:21 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:21 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9b53a-7805-40d7-831d-4c2acc28a931]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:21 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:21 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:21 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 1.023s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Attempting download of 5cf81ded-5878-484c-9c40-885d0ef8b171 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}])) to volume 99ba1a04-1c45-4739-8b86-58aef6a115d4. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c947ed5-46c7-4b37-9e37-104ad68e3bb0]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:22 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px Jul 09 17:13:22 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:22 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.155s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Deleted volume successfully. Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a754b2a5-092d-4197-b223-dc72f204d0c2 tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-09ecedb8-4847-4c72-b60c-f5dd93247c0d-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:22 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.238s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:22 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea Jul 09 17:13:22 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Flow 'volume_create_manager' (f7cf1c7c-0545-415d-8ba1-5ecdc220a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fad487f-4629-45b6-9095-bbcd2133b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fad487f-4629-45b6-9095-bbcd2133b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059670259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e08383-c666-4f65-b492-6624c8381da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2123fc9b0bba45378b9a67255ebd0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:23Z,use_quota=True,user_id='2be2e088982a4a9e827930b279b79666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8668938b-cd64-44dd-a57f-c212201d5a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8668938b-cd64-44dd-a57f-c212201d5a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717a7ccc-7410-4a9d-b063-67432c581350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717a7ccc-7410-4a9d-b063-67432c581350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e08383-c666-4f65-b492-6624c8381da2', 'volume_name': 'volume-e0e08383-c666-4f65-b492-6624c8381da2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68a1e2a-a914-401c-b423-05dd88cc0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68a1e2a-a914-401c-b423-05dd88cc0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25ad6da-3a6c-41cc-a4c8-852d192d11cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:22 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Volume e0e08383-c666-4f65-b492-6624c8381da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e08383-c666-4f65-b492-6624c8381da2', 'volume_size': 1} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059670259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e08383-c666-4f65-b492-6624c8381da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2123fc9b0bba45378b9a67255ebd0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:23Z,use_quota=True,user_id='2be2e088982a4a9e827930b279b79666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Creating volume e0e08383-c666-4f65-b492-6624c8381da2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:22 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:22 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 1073741824 Jul 09 17:13:22 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:23 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px" returned: 0 in 1.226s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:23 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px Jul 09 17:13:23 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:23 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:23 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea Jul 09 17:13:23 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:23 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 1073741824" returned: 0 in 1.103s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:23 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 Jul 09 17:13:23 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:24 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px" returned: 1 in 0.898s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cf81ded-5878-484c-9c40-885d0ef8b171_2qnum7px' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c55f681-da21-413e-9727-422f37f0aa59]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:24 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD Jul 09 17:13:24 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:24 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.f62728c8-bec9-4c65-a694-168744eb04ea" returned: 0 in 0.737s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-f62728c8-bec9-4c65-a694-168744eb04ea" released by "_delete_snapshot" :: held 3.976s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_snapshot" :: held 4.012s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Created reservations ['95771c0c-3354-4adf-91f2-c85e6d66bcf8', 'ac016684-6b95-4004-abc8-552cd83f932d', 'a8e6531b-278d-4058-98d4-a2036e7f2c1b', '5ef52bad-a369-4429-af07-d9a7847f3845'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Delete snapshot completed successfully. Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91ef54a9-8164-4832-b04f-0bad37e8fe9b tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-f62728c8-bec9-4c65-a694-168744eb04ea-delete_snapshot" released by "delete_snapshot" :: held 4.178s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:24 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25ad6da-3a6c-41cc-a4c8-852d192d11cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e08383-c666-4f65-b492-6624c8381da2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6194f36-a42c-4e82-976b-5778af5c1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Volume volume-e0e08383-c666-4f65-b492-6624c8381da2 (e0e08383-c666-4f65-b492-6624c8381da2): created successfully Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6194f36-a42c-4e82-976b-5778af5c1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Flow 'volume_create_manager' (f7cf1c7c-0545-415d-8ba1-5ecdc220a48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-478e05b9-fbd1-45a3-9f2b-522b72651332 tempest-VolumesTransfersV355Test-286844778 None] Created volume successfully. Jul 09 17:13:24 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] 5cf81ded-5878-484c-9c40-885d0ef8b171 was qcow2, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:24 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:24 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Creating offline snapshot 08458170-d11a-4b16-a4d0-a640d3901450 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf668b71-216e-46dc-87ca-bbd4ffcdef77]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:25 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:25 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:25 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:25 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 1G Jul 09 17:13:25 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "cinder-e0e08383-c666-4f65-b492-6624c8381da2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-e0e08383-c666-4f65-b492-6624c8381da2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "cinder-quobyte-e0e08383-c666-4f65-b492-6624c8381da2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-quobyte-e0e08383-c666-4f65-b492-6624c8381da2" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce268d-d3a3-4b4b-9dfc-afc0e5934cc6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:26 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 Jul 09 17:13:26 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:26 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 2.028s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5cf81ded-5878-484c-9c40-885d0ef8b171_t6daojuwdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:13:26 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Converted 112.00 MB image at 55.19 MB/s Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:26 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 1G" returned: 0 in 1.065s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:26 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1G Jul 09 17:13:26 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:26 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 Jul 09 17:13:26 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:26 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2" returned: 0 in 0.826s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:26 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2 Jul 09 17:13:26 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:27 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 1G" returned: 0 in 0.690s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:27 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:27 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 is being set with open permissions: ugo+rw Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb004f-347f-4fa6-8b1e-dbd98515ced9]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:27 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 Jul 09 17:13:27 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:27 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e0e08383-c666-4f65-b492-6624c8381da2" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-quobyte-e0e08383-c666-4f65-b492-6624c8381da2" released by "delete_volume" :: held 1.587s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:27 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:27 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Created reservations ['caf2b7e8-f2e2-4366-a6f6-2448a979e546', '5ab1f685-2f4c-4e18-819b-4837efdb5dfa', 'b2623561-1214-4b40-9153-822d2f5fb75c', 'b6f0eebf-6633-4d28-81a5-d5865a9b3b2c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:27 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:27 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:28 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450" returned: 0 in 0.735s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e9dad97e-a196-42d6-a64a-db794bd03a65 tempest-SnapshotsActionsTest-1258428 None] Create snapshot completed successfully Jul 09 17:13:28 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 0.872s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:28 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.708s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Deleted volume successfully. Jul 09 17:13:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1027b377-a5ed-4929-9149-650692edf34f tempest-VolumesTransfersV355Test-150132358 None] Lock "cinder-e0e08383-c666-4f65-b492-6624c8381da2-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:28 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:28 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-08458170-d11a-4b16-a4d0-a640d3901450-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-08458170-d11a-4b16-a4d0-a640d3901450-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-08458170-d11a-4b16-a4d0-a640d3901450" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-08458170-d11a-4b16-a4d0-a640d3901450" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Deleting offline snapshot 08458170-d11a-4b16-a4d0-a640d3901450 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] snapshot_file for this snap is: volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242eb81-8913-4a11-bb74-f87f243ad117]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:29 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 1 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Downloaded image 5cf81ded-5878-484c-9c40-885d0ef8b171 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}])) to volume 99ba1a04-1c45-4739-8b86-58aef6a115d4 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Temporary image 5cf81ded-5878-484c-9c40-885d0ef8b171 for user ba411de50c2244aa84f051baf4f13367 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Marking volume 99ba1a04-1c45-4739-8b86-58aef6a115d4 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Copying metadata from image 5cf81ded-5878-484c-9c40-885d0ef8b171 to 99ba1a04-1c45-4739-8b86-58aef6a115d4. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Creating volume glance metadata for volume 99ba1a04-1c45-4739-8b86-58aef6a115d4 backed by image 5cf81ded-5878-484c-9c40-885d0ef8b171 with: {'image_id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'image_name': 'tempest-scenario-img--1063340979', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:13:29 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 Jul 09 17:13:29 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840d5ab9-2828-4637-8731-a0960e6748f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ba1a04-1c45-4739-8b86-58aef6a115d4', 'volume_size': 1, 'image_id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cf81ded-5878-484c-9c40-885d0ef8b171', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1063340979', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4f24355d6a3452cbeef841efc4e3a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5cf81ded-5878-484c-9c40-885d0ef8b171', 'created_at': datetime.datetime(2026, 7, 9, 15, 13, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cf81ded-5878-484c-9c40-885d0ef8b171/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2a3a5b-95c8-4a33-8079-e6589046693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Volume volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 (99ba1a04-1c45-4739-8b86-58aef6a115d4): created successfully Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2a3a5b-95c8-4a33-8079-e6589046693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Flow 'volume_create_manager' (a5372568-4a4d-4c11-9d1d-7cedff4e9aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7604ce60-9ada-49d7-99ff-a2baf88e4ef0 tempest-TestInstancesWithCinderVolumes-1248001463 None] Created volume successfully. Jul 09 17:13:30 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450" returned: 0 in 0.884s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:30 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1debd0c4-bf40-47c9-b1bb-243aa6e418f6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:30 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:30 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:31 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.954s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:31 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 Jul 09 17:13:31 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:32 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450" returned: 0 in 0.949s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:32 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450 Jul 09 17:13:32 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:32 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.08458170-d11a-4b16-a4d0-a640d3901450" returned: 0 in 0.762s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-08458170-d11a-4b16-a4d0-a640d3901450" released by "_delete_snapshot" :: held 3.701s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_snapshot" :: held 3.736s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=103,cinder:INSERT=28,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:13:32 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=112,cinder:DELETE=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Created reservations ['49d6b36f-d3dc-418b-8f81-4b1e58a5604c', '432ad85c-ac1e-4c21-a78f-81bed56585d0', '2bc04956-e570-44cc-99f8-0f7495dba356', '343986b7-c065-4bc1-a0aa-24fb722483fb'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Delete snapshot completed successfully. Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4e490ac4-3763-419b-bf90-7c897406a2ba tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-08458170-d11a-4b16-a4d0-a640d3901450-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Creating offline snapshot 712f5aa7-a78c-42f3-8e68-08bf9dabf336 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6982285-b17c-4bad-a16f-392f745386b7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:33 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:33 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:34 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.795s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:34 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 1G Jul 09 17:13:34 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Flow 'volume_create_manager' (41e0110d-3d02-4246-820d-fa9b6f5c7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c009fea7-5225-4f08-a67a-0f8353611dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c009fea7-5225-4f08-a67a-0f8353611dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1793079500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32622b9d-8f41-4627-bdf1-8ff63ba63a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37aa1d9bbbc42cd89272f1b559a6ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:35Z,use_quota=True,user_id='f5b6db90873f4eedbb96a07d2927088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6f7ab-9518-48d1-b7ca-c74e7e350e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6f7ab-9518-48d1-b7ca-c74e7e350e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b895ceb-2f9e-4ed7-ac2e-1575201d011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b895ceb-2f9e-4ed7-ac2e-1575201d011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32622b9d-8f41-4627-bdf1-8ff63ba63a7e', 'volume_name': 'volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf0435-cc61-40fa-a7d2-ccfffc883dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf0435-cc61-40fa-a7d2-ccfffc883dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379e907-fc64-4a8e-a497-b01626b973ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Trying to clone 32622b9d-8f41-4627-bdf1-8ff63ba63a7e from image cd66455c-9772-4d79-b400-0ea9cf463a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:13:35 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 1G" returned: 0 in 0.928s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:35 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 Jul 09 17:13:35 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:13:35 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Image download 20.69 MB at 20.69 MB/s Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0278b49-6c90-4d25-adef-5cc6832e82a7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:35 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD Jul 09 17:13:35 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:36 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336" returned: 0 in 0.726s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:36 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 is being set with open permissions: ugo+rw Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:36 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 Jul 09 17:13:36 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:36 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 is fetched for user f5b6db90873f4eedbb96a07d2927088e. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4739728-85bf-4ba8-8382-6db12d758983]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:36 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD Jul 09 17:13:36 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:36 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336" returned: 0 in 0.684s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-faca389c-321d-4bcf-9a37-8826bc7552d9 tempest-SnapshotsActionsTest-1258428 None] Create snapshot completed successfully Jul 09 17:13:37 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1793079500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32622b9d-8f41-4627-bdf1-8ff63ba63a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37aa1d9bbbc42cd89272f1b559a6ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:35Z,use_quota=True,user_id='f5b6db90873f4eedbb96a07d2927088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Creating volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:37 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1073741824 Jul 09 17:13:37 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-712f5aa7-a78c-42f3-8e68-08bf9dabf336-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-712f5aa7-a78c-42f3-8e68-08bf9dabf336-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-712f5aa7-a78c-42f3-8e68-08bf9dabf336" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-712f5aa7-a78c-42f3-8e68-08bf9dabf336" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Deleting offline snapshot 712f5aa7-a78c-42f3-8e68-08bf9dabf336 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] snapshot_file for this snap is: volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[15256166-f972-453c-95ad-27ef5481587b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:38 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 Jul 09 17:13:38 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:38 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1073741824" returned: 0 in 1.107s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:38 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:38 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:39 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336" returned: 0 in 0.876s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf307ca1-d1d6-4f0d-9920-e1806213b685]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:39 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:39 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:39 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 0.716s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.805s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Attempting download of cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b76443-ad0e-4c68-a120-d1f357348570]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d6d88-6283-4105-9ca4-b59280571851]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:39 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:39 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:39 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz Jul 09 17:13:39 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:39 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:39 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 Jul 09 17:13:39 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:40 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 0.866s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:40 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz" returned: 0 in 0.828s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:40 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:13:40 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:40 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz Jul 09 17:13:40 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:40 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336" returned: 0 in 0.907s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:40 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336 Jul 09 17:13:40 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:40 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz" returned: 1 in 0.805s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_udhjknpz' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad055811-0e8c-47b7-ac93-3b7dda80972b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:41 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 1 in 0.848s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.778s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-99ba1a04-1c45-4739-8b86-58aef6a115d4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7858e8fc-6935-4bba-a739-6302bc5b6b08', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:13:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-63ea1c64-8e29-4918-9afe-0d6134b24336 req-837b97fd-d035-4cd2-9c5d-946ce6e39dec tempest-TestInstancesWithCinderVolumes-1248001463 None] attachment_update completed successfully. Jul 09 17:13:41 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD Jul 09 17:13:41 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:41 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.712f5aa7-a78c-42f3-8e68-08bf9dabf336" returned: 0 in 0.728s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-712f5aa7-a78c-42f3-8e68-08bf9dabf336" released by "_delete_snapshot" :: held 3.432s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_snapshot" :: held 3.472s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Created reservations ['5dc4718f-1480-4965-abbb-554579fdf659', '035603b3-e303-4214-9e2c-6f54a7621961', '28e758bf-f639-45c6-a934-665012a8ef8e', '75c4a4eb-e4b5-4b25-a3d5-2ec88143ac63'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Delete snapshot completed successfully. Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0db27552-fec3-476e-a65a-a76073e6712a tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-712f5aa7-a78c-42f3-8e68-08bf9dabf336-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:41 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] cd66455c-9772-4d79-b400-0ea9cf463a75 was qcow2, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:13:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:41 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:41 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Creating offline snapshot 96b37838-91b5-449e-8b95-ad84d63801b3 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:13:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc46f9f-b952-4d9d-9863-a8f9516b4154]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:42 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:42 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:43 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:43 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 1G Jul 09 17:13:43 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:43 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 2.044s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_ojhe6g2tdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:13:43 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Converted 112.00 MB image at 54.77 MB/s Jul 09 17:13:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:43 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1G Jul 09 17:13:43 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:44 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 1G" returned: 0 in 1.210s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:44 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 1G" returned: 0 in 1.007s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:44 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 Jul 09 17:13:44 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1078363-e2db-4282-b3c2-644fdbb78b5e]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:45 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:45 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:45 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3" returned: 0 in 0.976s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:45 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 is being set with open permissions: ugo+rw Jul 09 17:13:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:45 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 Jul 09 17:13:45 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:45 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 1.046s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:46 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:46 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:46 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.085s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-436d34c2-8984-47fd-947c-7ad547fde61a tempest-SnapshotsActionsTest-1258428 None] Create snapshot completed successfully Jul 09 17:13:47 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 1 in 1.131s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Downloaded image cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 for user f5b6db90873f4eedbb96a07d2927088e is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Marking volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Copying metadata from image cd66455c-9772-4d79-b400-0ea9cf463a75 to 32622b9d-8f41-4627-bdf1-8ff63ba63a7e. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Creating volume glance metadata for volume 32622b9d-8f41-4627-bdf1-8ff63ba63a7e backed by image cd66455c-9772-4d79-b400-0ea9cf463a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379e907-fc64-4a8e-a497-b01626b973ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b24345a-628c-4a9e-baef-087e8a7c12c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Volume volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e (32622b9d-8f41-4627-bdf1-8ff63ba63a7e): created successfully Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b24345a-628c-4a9e-baef-087e8a7c12c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Flow 'volume_create_manager' (41e0110d-3d02-4246-820d-fa9b6f5c7d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a72b5bcb-2ce8-481b-9f27-e45e970642ae tempest-VolumesExtendTest-915258571 None] Created volume successfully. Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-96b37838-91b5-449e-8b95-ad84d63801b3-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-96b37838-91b5-449e-8b95-ad84d63801b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Acquiring lock "cinder-quobyte-96b37838-91b5-449e-8b95-ad84d63801b3" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-96b37838-91b5-449e-8b95-ad84d63801b3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Deleting offline snapshot 96b37838-91b5-449e-8b95-ad84d63801b3 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] snapshot_file for this snap is: volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[05efeabe-bb31-45a6-9616-ff1beb25b48d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a671211e-2c1a-4c50-8305-5b05a69ee4ed]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:48 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 Jul 09 17:13:48 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:48 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:48 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:49 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3" returned: 0 in 1.192s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95e4209-8f41-41fc-916c-37807d499265]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:50 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:50 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:50 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 1.413s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:50 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:50 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:51 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.312s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:51 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 Jul 09 17:13:51 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:51 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 1 in 1.249s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 2G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-b5a5911c-350a-4b07-a64f-077fdba0fdcd tempest-TestShelveInstance-906958860 None] Terminate volume connection completed successfully. Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-b5a5911c-350a-4b07-a64f-077fdba0fdcd tempest-TestShelveInstance-906958860 None] Deleting attachment f13a9985-0e51-4cfe-9237-7a894bd3044d. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e 2G" returned: 0 in 0.092s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.851s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aa5c1377-5868-46b0-b572-61b568fd55d2 tempest-VolumesExtendTest-915258571 None] Extend volume completed successfully. Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Acquiring lock "cinder-45d31bc1-f81e-4d82-a3fd-2113013dc1fe-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "cinder-45d31bc1-f81e-4d82-a3fd-2113013dc1fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Acquiring lock "cinder-quobyte-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "cinder-quobyte-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2911fca8-e773-443e-95b9-dccd250d3c57]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-32622b9d-8f41-4627-bdf1-8ff63ba63a7e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "cinder-32622b9d-8f41-4627-bdf1-8ff63ba63a7e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-quobyte-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:52 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:13:52 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977ef32-c43a-4302-84be-c2ea09d3491a]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:52 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3" returned: 0 in 1.416s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:52 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3 Jul 09 17:13:52 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:52 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:52 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:53 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 1.609s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:53 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 1.376s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:54 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:13:54 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:54 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:54 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:54 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.96b37838-91b5-449e-8b95-ad84d63801b3" returned: 0 in 1.628s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-96b37838-91b5-449e-8b95-ad84d63801b3" released by "_delete_snapshot" :: held 5.760s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_snapshot" :: held 5.803s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:54 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Created reservations ['77e65098-06ce-4939-97aa-4d01a7e044c6', '274efb41-3463-4dbc-96de-3899ff4ef208', 'd4fb6235-7d84-4a14-a34d-732f1a043efa', 'ca2b1bc8-dc80-4154-9b11-5adc819798d4'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Delete snapshot completed successfully. Jul 09 17:13:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cbaa1b12-7165-4d0e-9376-3bd219b90d8e tempest-SnapshotsActionsTest-412680530 None] Lock "cinder-96b37838-91b5-449e-8b95-ad84d63801b3-delete_snapshot" released by "delete_snapshot" :: held 6.067s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:55 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 1 in 1.474s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:55 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e Jul 09 17:13:55 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "cinder-51f070cb-c003-4b13-812a-74ce1ebc1775-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-51f070cb-c003-4b13-812a-74ce1ebc1775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:55 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 1 in 1.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_snapshot" :: waited 0.090s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "cinder-quobyte-51f070cb-c003-4b13-812a-74ce1ebc1775" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-51f070cb-c003-4b13-812a-74ce1ebc1775" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Deleting offline snapshot 51f070cb-c003-4b13-812a-74ce1ebc1775 of volume 0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:13:55 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe Jul 09 17:13:55 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] snapshot_file for this snap is: volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332516e-0c65-4afe-82fa-85c7fbb95e31]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:56 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:56 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:57 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" returned: 0 in 1.620s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-32622b9d-8f41-4627-bdf1-8ff63ba63a7e" released by "delete_volume" :: held 4.612s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Created reservations ['be5263f4-6f07-415c-836d-8aa0a3fec989', 'b1a2e83f-e0cc-45b8-bfc7-eb00fda42222', '0282f35f-cfa8-4509-9570-8b33ea3570c6', 'f0b14349-a2a4-445a-b7cf-9efcda13af88'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:57 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.463s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae899222-4e77-4c2c-81c9-a9241eb9cd2c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:57 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" returned: 0 in 1.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "cinder-quobyte-45d31bc1-f81e-4d82-a3fd-2113013dc1fe" released by "delete_volume" :: held 5.337s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:57 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:57 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.quota [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Created reservations ['e19f63a9-1c58-42ac-89ab-3c04049cc510', 'f97a6712-b451-4fc7-9e2b-bc121634f598', '03a1f571-e93d-449a-ba64-9404c8ab6b1f', '9255fd1a-31e4-4e17-bb04-65a276798484'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:13:57 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 Jul 09 17:13:57 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:57 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:13:57 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:58 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.220s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:58 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Deleted volume successfully. Jul 09 17:13:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cabe4dab-c153-488f-bbc0-cca8e1c589cc tempest-VolumesExtendTest-915258571 None] Lock "cinder-32622b9d-8f41-4627-bdf1-8ff63ba63a7e-delete_volume" released by "delete_volume" :: held 6.385s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:59 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.291s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.manager [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:13:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Deleted volume successfully. Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [req-e2bc252c-2fdc-43df-88ab-29aeafecfb4d req-7f7f428c-73bd-49ce-a404-80710f0f6c63 tempest-TestShelveInstance-906958860 None] Lock "cinder-45d31bc1-f81e-4d82-a3fd-2113013dc1fe-delete_volume" released by "delete_volume" :: held 7.069s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:13:59 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" returned: 0 in 1.957s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:59 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:13:59 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Flow 'volume_create_manager' (95d091c5-db27-485e-92f5-a4cd7d9f3170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cbb151-e114-4446-a6fd-1b988c873fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cbb151-e114-4446-a6fd-1b988c873fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-38654389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dea56cc-d23b-4dca-9798-6dd58c2cd847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37aa1d9bbbc42cd89272f1b559a6ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:59Z,use_quota=True,user_id='f5b6db90873f4eedbb96a07d2927088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa62fe60-7aa1-41bd-8919-dd12d5cf2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa62fe60-7aa1-41bd-8919-dd12d5cf2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a4ed55-52fd-476a-a7a9-dca8c2714e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a4ed55-52fd-476a-a7a9-dca8c2714e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dea56cc-d23b-4dca-9798-6dd58c2cd847', 'volume_name': 'volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af11657-286a-4370-bb68-8700ca66442a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af11657-286a-4370-bb68-8700ca66442a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207d4d4-a48f-4606-ab48-c3605417c938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:13:59 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Volume 1dea56cc-d23b-4dca-9798-6dd58c2cd847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847', 'volume_size': 1} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-38654389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dea56cc-d23b-4dca-9798-6dd58c2cd847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37aa1d9bbbc42cd89272f1b559a6ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:13:59Z,use_quota=True,user_id='f5b6db90873f4eedbb96a07d2927088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Creating volume 1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:13:59 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:13:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:13:59 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 1073741824 Jul 09 17:13:59 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:00 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:00 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:00 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.297s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:00 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775 Jul 09 17:14:00 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:01 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 1073741824" returned: 0 in 1.785s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:01 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:01 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:01 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.029s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 28 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:14:01 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48.51f070cb-c003-4b13-812a-74ce1ebc1775" returned: 0 in 1.022s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-51f070cb-c003-4b13-812a-74ce1ebc1775" released by "_delete_snapshot" :: held 5.940s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_snapshot" :: held 5.978s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Created reservations ['df0228ed-ad79-420e-b83b-29fe111d9b1e', '9c2f9c49-168c-45f1-91cc-309c7a2c437f', 'aecaa97a-a19d-4d88-b065-32f3300707c0', '63015b6b-618b-4c31-a7ab-debc631d6d6c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Delete snapshot completed successfully. Jul 09 17:14:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140eb0fa-64d8-44b2-be25-c4cc57483eff tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-51f070cb-c003-4b13-812a-74ce1ebc1775-delete_snapshot" released by "delete_snapshot" :: held 6.323s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:02 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 0.900s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] <== create_volume: return (2771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207d4d4-a48f-4606-ab48-c3605417c938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830e6fda-6b41-4d63-9c11-c4f7abdbba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:02 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Volume volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 (1dea56cc-d23b-4dca-9798-6dd58c2cd847): created successfully Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830e6fda-6b41-4d63-9c11-c4f7abdbba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Flow 'volume_create_manager' (95d091c5-db27-485e-92f5-a4cd7d9f3170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "cinder-0655629b-44d6-4e4a-a2aa-2a0cfff44b48-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:02 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8831d68a-45a2-40b1-8326-3d60d78b1e87 tempest-VolumesExtendTest-915258571 None] Created volume successfully. Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-0655629b-44d6-4e4a-a2aa-2a0cfff44b48-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" acquired by "delete_volume" :: waited 0.049s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265533a-c594-4145-9ebc-1f77352c21a2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:02 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 Jul 09 17:14:02 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Creating offline snapshot cd85b1d0-d4d7-4255-a957-1ba3f3df9aee of volume 1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879e4ae-6619-4114-9c10-fccefbcdfdfd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:03 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:03 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:03 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" returned: 0 in 1.017s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:03 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48 Jul 09 17:14:03 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:04 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 1.042s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:04 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee 1G Jul 09 17:14:04 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:04 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" returned: 0 in 0.838s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-quobyte-0655629b-44d6-4e4a-a2aa-2a0cfff44b48" released by "delete_volume" :: held 1.996s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Created reservations ['7606c572-7cda-48d1-8f4a-205f2560b4fe', 'a14a0ff4-bd47-4354-8f24-f46b1e8708fb', '96f3cd76-ac50-4d9a-a535-fd8e6d74ba2a', '593fd49f-7421-4993-bc3e-705788180244'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:04 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:04 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:05 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee 1G" returned: 0 in 1.001s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:05 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee Jul 09 17:14:05 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:05 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.777s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:05 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Deleted volume successfully. Jul 09 17:14:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4de50b2-f48c-46ae-aacd-a77fdaf56a3d tempest-SnapshotsActionsTest-1258428 None] Lock "cinder-0655629b-44d6-4e4a-a2aa-2a0cfff44b48-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:06 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" returned: 0 in 0.765s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:06 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee is being set with open permissions: ugo+rw Jul 09 17:14:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:06 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee Jul 09 17:14:06 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:06 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" returned: 0 in 0.703s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:06 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info Jul 09 17:14:06 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:07 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:07 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info is being set with open permissions: ugo+rw Jul 09 17:14:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:07 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info Jul 09 17:14:07 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:08 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.info" returned: 0 in 0.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.218s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a24d77b1-4dae-4f4f-be68-944c6660e311 tempest-VolumesExtendTest-915258571 None] Create snapshot completed successfully Jul 09 17:14:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9395f-6fe3-4064-bd91-be564b42b977]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:09 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:09 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:10 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee 2G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee 2G" returned: 0 in 0.180s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.138s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:10 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bd08c661-4264-4c33-b09f-173cc9e9e093 tempest-VolumesExtendTest-915258571 None] Extend volume completed successfully. Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-quobyte-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Deleting offline snapshot cd85b1d0-d4d7-4255-a957-1ba3f3df9aee of volume 1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:14:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] snapshot_file for this snap is: volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:14:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7094a-72b5-42e5-a3ac-51d5720a52ff]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:12 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee Jul 09 17:14:12 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:12 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" returned: 0 in 0.982s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf72da3-d6c6-4f43-b08d-c45d1d6d01f6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:13 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:13 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (96b00f02-ea0d-4dcf-90be-cff9d4b403d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b5bcd8-7904-4625-8b27-e8e34260d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b5bcd8-7904-4625-8b27-e8e34260d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892383532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e823f3-80d2-4b71-a8a1-ee601a62aa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:14Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aac8f6-35f3-4204-aa8c-08716f768101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aac8f6-35f3-4204-aa8c-08716f768101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b788f0-ceb4-4a04-b779-8da733cafce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b788f0-ceb4-4a04-b779-8da733cafce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e823f3-80d2-4b71-a8a1-ee601a62aa1c', 'volume_name': 'volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610a567-936f-4fed-b989-55c2e3d020e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610a567-936f-4fed-b989-55c2e3d020e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51332e-364a-43b7-ac72-eb86e27c369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume b3e823f3-80d2-4b71-a8a1-ee601a62aa1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c', 'volume_size': 1} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892383532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e823f3-80d2-4b71-a8a1-ee601a62aa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:14Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:13 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:13 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c 1073741824 Jul 09 17:14:13 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:14 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 1.051s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:14 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee Jul 09 17:14:14 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:15 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c 1073741824" returned: 0 in 1.326s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:15 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c Jul 09 17:14:15 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:15 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" returned: 0 in 1.401s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:15 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee Jul 09 17:14:15 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:16 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" returned: 0 in 0.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51332e-364a-43b7-ac72-eb86e27c369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e84925a-1374-4c95-941d-f057657961a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c (b3e823f3-80d2-4b71-a8a1-ee601a62aa1c): created successfully Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e84925a-1374-4c95-941d-f057657961a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (96b00f02-ea0d-4dcf-90be-cff9d4b403d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-073e54ad-a355-4a01-b72d-a64b4e94aac8 tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:16 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847.cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" returned: 0 in 0.685s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee" released by "_delete_snapshot" :: held 4.306s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" released by "delete_snapshot" :: held 4.338s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Created reservations ['26f4cb3a-b89b-4392-bccc-4e336a9395a1', '04c2d02a-bb19-4434-a7d7-40702305c831', '2725641a-01d6-46e0-b195-164a80ad9194', '5becdbc6-2e6f-4f48-a15a-4b248eda3f6c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Delete snapshot completed successfully. Jul 09 17:14:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e6a3352d-c444-477f-aebe-ae4640c74134 tempest-VolumesExtendTest-915258571 None] Lock "cinder-cd85b1d0-d4d7-4255-a957-1ba3f3df9aee-delete_snapshot" released by "delete_snapshot" :: held 4.497s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating offline snapshot b5d03b48-e831-457b-9a95-4bd93034d8f4 of volume b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f5b4e-85c5-458e-a902-c7963cda4412]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-1dea56cc-d23b-4dca-9798-6dd58c2cd847-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "cinder-1dea56cc-d23b-4dca-9798-6dd58c2cd847-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Acquiring lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:17 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c Jul 09 17:14:17 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a41c6-cc53-41f0-a218-a95d5eafebe5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:17 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:17 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:18 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" returned: 0 in 0.985s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:18 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 1G Jul 09 17:14:18 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:18 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 0.955s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:18 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847 Jul 09 17:14:18 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:19 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1dea56cc-d23b-4dca-9798-6dd58c2cd847" returned: 0 in 0.710s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "cinder-quobyte-1dea56cc-d23b-4dca-9798-6dd58c2cd847" released by "delete_volume" :: held 1.757s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:19 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 1G" returned: 0 in 0.963s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:19 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 Jul 09 17:14:19 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Created reservations ['fa064d7b-12b4-487f-99bf-d1a74c9e127d', 'ae3e69e7-ba7b-46e6-8d11-6eb0f1768bb6', '27868090-1f5b-459f-aab6-d6fdfdc7c88d', '8041d1da-2ccc-44e0-834e-bb15c4c4d970'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:19 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:19 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Flow 'volume_create_manager' (f6719068-d2cf-4f89-8d0f-5c87ab0468b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a265627-0c7b-475d-b8b8-f661accf30e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a265627-0c7b-475d-b8b8-f661accf30e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1334963964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715d5f92-377e-4081-9d90-dd95cf01a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f547652a0994c8c8c49cc6d0007d1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:19Z,use_quota=True,user_id='b3f4c37059874f9aaa87bdc8d7450d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5cce60-34c3-45d0-a682-75c05cb04e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5cce60-34c3-45d0-a682-75c05cb04e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b81b2a-0e6e-45c6-9ac1-eb63af520062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b81b2a-0e6e-45c6-9ac1-eb63af520062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715d5f92-377e-4081-9d90-dd95cf01a96f', 'volume_name': 'volume-715d5f92-377e-4081-9d90-dd95cf01a96f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72c5f94-a11e-4f75-9b07-70cfa027c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72c5f94-a11e-4f75-9b07-70cfa027c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc1f3a7-7e40-4708-a90d-57cde76bab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Volume 715d5f92-377e-4081-9d90-dd95cf01a96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715d5f92-377e-4081-9d90-dd95cf01a96f', 'volume_size': 1} Jul 09 17:14:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:20 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:20 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 is being set with open permissions: ugo+rw Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:20 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 Jul 09 17:14:20 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:20 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Deleted volume successfully. Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f926a320-f280-4d05-9517-5ec47456c35c tempest-VolumesExtendTest-915258571 None] Lock "cinder-1dea56cc-d23b-4dca-9798-6dd58c2cd847-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:20 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4" returned: 0 in 0.703s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:20 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info Jul 09 17:14:20 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:21 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info" returned: 0 in 0.706s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:21 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info is being set with open permissions: ugo+rw Jul 09 17:14:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:21 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info Jul 09 17:14:21 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:22 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.info" returned: 0 in 0.689s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.964s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.803s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33a1a0-76fd-4f28-ab25-01fe8243b5c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b7d2f558-c495-40cc-bbd2-a9f1ace9b679 tempest-CreateVolumesFromSnapshotTest-641413104 None] Create snapshot completed successfully Jul 09 17:14:22 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 Jul 09 17:14:22 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (455264e3-e2ee-4ca4-81b9-80ce21ec2312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad2455a-2a8f-4943-a000-9ae80a3180b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad2455a-2a8f-4943-a000-9ae80a3180b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-932147823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b162e3ab-c701-479b-a737-7bb151eb28af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:22Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de9b275-bd71-4624-8626-9b190fbba1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de9b275-bd71-4624-8626-9b190fbba1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33805800-408e-41d7-ae85-ff4faa5119c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33805800-408e-41d7-ae85-ff4faa5119c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b162e3ab-c701-479b-a737-7bb151eb28af', 'volume_name': 'volume-b162e3ab-c701-479b-a737-7bb151eb28af', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd942c68-0f79-44a5-8a9a-9e5f9179972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd942c68-0f79-44a5-8a9a-9e5f9179972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c882eba0-d92d-4df0-9705-c5ca78388893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:22 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Volume b162e3ab-c701-479b-a737-7bb151eb28af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b162e3ab-c701-479b-a737-7bb151eb28af', 'volume_size': 1} Jul 09 17:14:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:23 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66" returned: 0 in 0.793s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.384s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1334963964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715d5f92-377e-4081-9d90-dd95cf01a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f547652a0994c8c8c49cc6d0007d1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:19Z,use_quota=True,user_id='b3f4c37059874f9aaa87bdc8d7450d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Creating volume 715d5f92-377e-4081-9d90-dd95cf01a96f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:23 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:23 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f 1073741824 Jul 09 17:14:23 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-553002a3-6f8b-425d-b7ec-792447decb66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bc61c80-e710-4845-be4c-f51c67d27c53', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (c72f63aa-fd54-4480-845e-4c25b7ad8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a8780c-e17e-4190-a2eb-a151515d4b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a8780c-e17e-4190-a2eb-a151515d4b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-718310683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df62aaa-3550-4af5-8489-d2eccbe127b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:23Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17652b96-809e-4f27-8137-1d5c16c20b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17652b96-809e-4f27-8137-1d5c16c20b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964662ae-ed42-4a66-b6de-ae9402ed0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964662ae-ed42-4a66-b6de-ae9402ed0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df62aaa-3550-4af5-8489-d2eccbe127b8', 'volume_name': 'volume-0df62aaa-3550-4af5-8489-d2eccbe127b8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc50eab-ea5f-4e8f-9e56-ccd771e47dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc50eab-ea5f-4e8f-9e56-ccd771e47dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60150f1-65af-4ff3-be55-cb7ba8813565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume 0df62aaa-3550-4af5-8489-d2eccbe127b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df62aaa-3550-4af5-8489-d2eccbe127b8', 'volume_size': 1} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-636d4b83-ac92-4337-95c6-f6d437970fcd req-da113a74-b275-43b5-8a39-c437191db545 tempest-TestInstancesWithCinderVolumes-1248001463 None] attachment_update completed successfully. Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (b67adc67-01c7-4a73-8cb7-03b704c51769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785a3d62-caa2-4926-a2e8-51701643e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785a3d62-caa2-4926-a2e8-51701643e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664654219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df62a1f-cdf3-44f5-b863-d8c97da8f772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1c156-8a92-4624-a127-a39adfc340d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1c156-8a92-4624-a127-a39adfc340d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d910fca-9696-47f0-8c43-504f5a6dc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d910fca-9696-47f0-8c43-504f5a6dc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df62a1f-cdf3-44f5-b863-d8c97da8f772', 'volume_name': 'volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536c6767-2577-4fe6-9130-97b6c3709e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536c6767-2577-4fe6-9130-97b6c3709e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57debe1-591e-4845-88b0-8eceb2b83b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume 9df62a1f-cdf3-44f5-b863-d8c97da8f772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772', 'volume_size': 1} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (60df9dad-b831-4ebf-9856-73d56909df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a835d9f-815b-4978-a850-d0a6b0a944cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a835d9f-815b-4978-a850-d0a6b0a944cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606503594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f199d779-5fe0-4a89-96f2-c758f49a45a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c299c-f905-4cd3-bb36-2cd708e6ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c299c-f905-4cd3-bb36-2cd708e6ca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241cd3fe-fe87-4dd4-9712-f29e17ee748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241cd3fe-fe87-4dd4-9712-f29e17ee748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f199d779-5fe0-4a89-96f2-c758f49a45a3', 'volume_name': 'volume-f199d779-5fe0-4a89-96f2-c758f49a45a3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2564993-5adb-45dd-9cbb-bf27db3f3e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2564993-5adb-45dd-9cbb-bf27db3f3e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b75007-a0fc-4874-8075-06a021679931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume f199d779-5fe0-4a89-96f2-c758f49a45a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f199d779-5fe0-4a89-96f2-c758f49a45a3', 'volume_size': 1} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:24 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f 1073741824" returned: 0 in 1.030s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:24 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f Jul 09 17:14:24 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (481fd9c9-9879-45fe-9eb1-1a29e54cd8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f586bf1-b15f-4bd2-b2b8-fe30d98ede8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f586bf1-b15f-4bd2-b2b8-fe30d98ede8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852118677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025e4d8e-6f3c-4294-992e-d467b9ec11a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85703801-f694-4a8b-8e29-c4e46bef742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85703801-f694-4a8b-8e29-c4e46bef742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7da3df3-f00e-45f5-af5a-5e7de0a4eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7da3df3-f00e-45f5-af5a-5e7de0a4eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025e4d8e-6f3c-4294-992e-d467b9ec11a8', 'volume_name': 'volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32988651-cda6-47f5-9b2e-f64de1306da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32988651-cda6-47f5-9b2e-f64de1306da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf088d7-26f7-4c2a-a678-bcad59280661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume 025e4d8e-6f3c-4294-992e-d467b9ec11a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8', 'volume_size': 1} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (dd838cba-e034-4791-badd-1583c8904a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c647c4-90b7-44e4-bd96-38b463c80b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c647c4-90b7-44e4-bd96-38b463c80b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282728408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bec08e-df9b-430c-bc20-9cc8eb2ddf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:25Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8b7b1-2aea-4dc2-9c31-ebe1d6ae793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8b7b1-2aea-4dc2-9c31-ebe1d6ae793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054979e5-feb1-444c-a171-37db77111ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054979e5-feb1-444c-a171-37db77111ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bec08e-df9b-430c-bc20-9cc8eb2ddf98', 'volume_name': 'volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a93b1-3e28-4231-b331-7b9704075c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a93b1-3e28-4231-b331-7b9704075c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec2142d-98df-461a-8505-f5e13632a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume 98bec08e-df9b-430c-bc20-9cc8eb2ddf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98', 'volume_size': 1} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f" returned: 0 in 0.765s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.263s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-932147823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b162e3ab-c701-479b-a737-7bb151eb28af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:22Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Creating volume b162e3ab-c701-479b-a737-7bb151eb28af {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc1f3a7-7e40-4708-a90d-57cde76bab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715d5f92-377e-4081-9d90-dd95cf01a96f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735cf1ff-91df-4179-a3c6-498afb5d9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:24 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af 1073741824 Jul 09 17:14:24 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Volume volume-715d5f92-377e-4081-9d90-dd95cf01a96f (715d5f92-377e-4081-9d90-dd95cf01a96f): created successfully Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735cf1ff-91df-4179-a3c6-498afb5d9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:24 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Flow 'volume_create_manager' (f6719068-d2cf-4f89-8d0f-5c87ab0468b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-170891a9-e9a4-441c-9f32-5608ec2a4282 tempest-VolumesServicesTestJSON-1739703724 None] Created volume successfully. Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Acquiring lock "cinder-715d5f92-377e-4081-9d90-dd95cf01a96f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "cinder-715d5f92-377e-4081-9d90-dd95cf01a96f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Acquiring lock "cinder-quobyte-715d5f92-377e-4081-9d90-dd95cf01a96f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "cinder-quobyte-715d5f92-377e-4081-9d90-dd95cf01a96f" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78c376-592c-4984-b107-42d55b4c0f70]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:25 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f Jul 09 17:14:25 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:25 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af 1073741824" returned: 0 in 0.970s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:25 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af Jul 09 17:14:25 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:26 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:26 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f Jul 09 17:14:26 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:26 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af" returned: 0 in 0.704s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.371s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-718310683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df62aaa-3550-4af5-8489-d2eccbe127b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:23Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume 0df62aaa-3550-4af5-8489-d2eccbe127b8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:26 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:26 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 1073741824 Jul 09 17:14:26 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c882eba0-d92d-4df0-9705-c5ca78388893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b162e3ab-c701-479b-a737-7bb151eb28af', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d222c7e-0907-4cff-8089-405f4d77915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Volume volume-b162e3ab-c701-479b-a737-7bb151eb28af (b162e3ab-c701-479b-a737-7bb151eb28af): created successfully Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d222c7e-0907-4cff-8089-405f4d77915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (455264e3-e2ee-4ca4-81b9-80ce21ec2312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:26 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7cdd45b2-71fa-4581-ba5e-59d1ed204cc0 tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:14:27 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-715d5f92-377e-4081-9d90-dd95cf01a96f" returned: 0 in 0.735s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "cinder-quobyte-715d5f92-377e-4081-9d90-dd95cf01a96f" released by "delete_volume" :: held 1.596s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Created reservations ['e89738c1-3555-4ee7-a5ac-b395b8a60613', 'f53a9b29-16a1-4da8-8c0c-2bdfe6aad87a', '345f8b82-26a2-4d2c-b65e-8d74e30a171e', '83e44983-4c4c-43c4-bbc5-97af9ef6c80e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:27 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:27 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:27 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (7176fbc5-1d4c-4749-9b48-c3887c11f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d34c85-5412-4d5f-a2ab-8f5dafecfc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 1073741824" returned: 0 in 1.207s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d34c85-5412-4d5f-a2ab-8f5dafecfc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576587403',display_name='tempest-VolumesGetTest-Volume-72756624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b250abe-cbeb-4ba0-8f42-a36215cc2a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:28Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c0213c-19f4-46aa-970d-abda6befa24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c0213c-19f4-46aa-970d-abda6befa24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24525bd4-82d5-4246-b706-9ba2a3d7044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24525bd4-82d5-4246-b706-9ba2a3d7044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b250abe-cbeb-4ba0-8f42-a36215cc2a07', 'volume_name': 'volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152bb679-ee2e-4ddb-b2b9-796c90494d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152bb679-ee2e-4ddb-b2b9-796c90494d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5318b371-ba54-4171-a70f-9b03b07e2e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Volume 5b250abe-cbeb-4ba0-8f42-a36215cc2a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07', 'volume_size': 1} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:27 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 Jul 09 17:14:27 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:28 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Deleted volume successfully. Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-4c32668f-2a6d-4c30-ba63-06af63ebc096 tempest-VolumesServicesTestJSON-1739703724 None] Lock "cinder-715d5f92-377e-4081-9d90-dd95cf01a96f-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:28 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8" returned: 0 in 0.681s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.974s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664654219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df62a1f-cdf3-44f5-b863-d8c97da8f772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume 9df62a1f-cdf3-44f5-b863-d8c97da8f772 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:28 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60150f1-65af-4ff3-be55-cb7ba8813565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df62aaa-3550-4af5-8489-d2eccbe127b8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:28 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 1073741824 Jul 09 17:14:28 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e9c3e1-f8f4-42eb-b7d6-15973ac6727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 (0df62aaa-3550-4af5-8489-d2eccbe127b8): created successfully Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e9c3e1-f8f4-42eb-b7d6-15973ac6727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (c72f63aa-fd54-4480-845e-4c25b7ad8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-349b6371-4323-49c7-9e16-b49e651d286a tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:29 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 1073741824" returned: 0 in 0.943s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:29 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 Jul 09 17:14:29 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:30 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772" returned: 0 in 0.795s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.414s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606503594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f199d779-5fe0-4a89-96f2-c758f49a45a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume f199d779-5fe0-4a89-96f2-c758f49a45a3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:30 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57debe1-591e-4845-88b0-8eceb2b83b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b53da9-3aed-4ad9-b37d-d8440b3c267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:30 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 1073741824 Jul 09 17:14:30 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:30 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 (9df62a1f-cdf3-44f5-b863-d8c97da8f772): created successfully Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b53da9-3aed-4ad9-b37d-d8440b3c267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (b67adc67-01c7-4a73-8cb7-03b704c51769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c95ec1aa-702a-4d27-a339-20e2bbe2ae0b tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:31 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 1073741824" returned: 0 in 0.971s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:31 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 Jul 09 17:14:31 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:32 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3" returned: 0 in 0.689s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.644s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852118677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025e4d8e-6f3c-4294-992e-d467b9ec11a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:24Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume 025e4d8e-6f3c-4294-992e-d467b9ec11a8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:32 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:32 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 1073741824 Jul 09 17:14:32 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b75007-a0fc-4874-8075-06a021679931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f199d779-5fe0-4a89-96f2-c758f49a45a3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72ae4a9-42f9-40a3-ac8f-37f61461f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:32 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 (f199d779-5fe0-4a89-96f2-c758f49a45a3): created successfully Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72ae4a9-42f9-40a3-ac8f-37f61461f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (60df9dad-b831-4ebf-9856-73d56909df48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3c36a743-cb1c-41e0-a703-f48c9f99a852 tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:33 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 1073741824" returned: 0 in 0.965s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:INSERT=27,cinder:UPDATE=110,cinder:SELECT=106,cinder:DELETE=8 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=101,cinder:INSERT=36,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:33 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 Jul 09 17:14:33 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:33 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.027s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282728408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bec08e-df9b-430c-bc20-9cc8eb2ddf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b59cf927624f0b950752a342ffbfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:25Z,use_quota=True,user_id='44a599d4d3e14d1cad6ff01277fe7893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Creating volume 98bec08e-df9b-430c-bc20-9cc8eb2ddf98 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:33 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 1073741824 Jul 09 17:14:33 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf088d7-26f7-4c2a-a678-bcad59280661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352fc10e-2306-467d-bc06-9d2226a76ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 (025e4d8e-6f3c-4294-992e-d467b9ec11a8): created successfully Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352fc10e-2306-467d-bc06-9d2226a76ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (481fd9c9-9879-45fe-9eb1-1a29e54cd8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-43f5161b-d2f3-468f-a780-e4d373b086eb tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:34 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 1073741824" returned: 0 in 0.893s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:34 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 Jul 09 17:14:34 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:35 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.710s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576587403',display_name='tempest-VolumesGetTest-Volume-72756624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b250abe-cbeb-4ba0-8f42-a36215cc2a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:28Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Creating volume 5b250abe-cbeb-4ba0-8f42-a36215cc2a07 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:35 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:35 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 1073741824 Jul 09 17:14:35 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec2142d-98df-461a-8505-f5e13632a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d2338f-31d8-4bb7-8c34-5b1794e6895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Volume volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 (98bec08e-df9b-430c-bc20-9cc8eb2ddf98): created successfully Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d2338f-31d8-4bb7-8c34-5b1794e6895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Flow 'volume_create_manager' (dd838cba-e034-4791-badd-1583c8904a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4e2edf03-e104-4663-9988-d7bd8e5e8bbd tempest-CreateVolumesFromSnapshotTest-641413104 None] Created volume successfully. Jul 09 17:14:36 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 1073741824" returned: 0 in 0.971s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:36 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 Jul 09 17:14:36 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-98bec08e-df9b-430c-bc20-9cc8eb2ddf98-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-98bec08e-df9b-430c-bc20-9cc8eb2ddf98-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c1397-0df0-471c-b6c9-d39e7f33e1c1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:37 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 Jul 09 17:14:37 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:37 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" returned: 0 in 0.781s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.282s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5318b371-ba54-4171-a70f-9b03b07e2e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3dcdf3-8468-475c-822e-9cfe26cc41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc59719-bfc7-4ed7-92fb-a00c9d0b037a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Volume volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 (5b250abe-cbeb-4ba0-8f42-a36215cc2a07): created successfully Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3dcdf3-8468-475c-822e-9cfe26cc41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (7176fbc5-1d4c-4749-9b48-c3887c11f92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f5a13dfa-72af-4c8d-9a95-d70e627c3f52 tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:14:37 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 Jul 09 17:14:37 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:37 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" returned: 0 in 0.910s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:37 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98 Jul 09 17:14:37 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:38 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979" returned: 0 in 0.907s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-e10dd552-ca63-4342-a4bc-4927e3b09979', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20cedbfc-a594-4187-affa-679f21da8978', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:14:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-457e65eb-fa34-4707-962d-9004f8aaa55a req-9b7838a3-0bfa-4f2b-8c2f-bb9e9a60450b tempest-TestInstancesWithCinderVolumes-1248001463 None] attachment_update completed successfully. Jul 09 17:14:38 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-98bec08e-df9b-430c-bc20-9cc8eb2ddf98" released by "delete_volume" :: held 1.802s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-5b250abe-cbeb-4ba0-8f42-a36215cc2a07-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "cinder-5b250abe-cbeb-4ba0-8f42-a36215cc2a07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['c95e84b7-57da-4c26-9e66-29b4708290f9', '005986d1-fcf0-4b27-bb91-87d6e560a7c0', '9019df7f-31e9-4a68-aacc-83e2db7acd81', '3f533892-dba6-45cc-8d5a-14ac91fbd4e4'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4e1ca-2a7d-4046-bda2-160920e1945f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:39 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:39 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 Jul 09 17:14:39 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:39 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-025e4d8e-6f3c-4294-992e-d467b9ec11a8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-025e4d8e-6f3c-4294-992e-d467b9ec11a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-025e4d8e-6f3c-4294-992e-d467b9ec11a8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-025e4d8e-6f3c-4294-992e-d467b9ec11a8" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622575d-233f-4860-91f6-9fad5319d6a1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:39 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 Jul 09 17:14:39 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:40 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.066s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:40 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f7ef242f-7000-4f20-b106-4ea621e83de1 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-98bec08e-df9b-430c-bc20-9cc8eb2ddf98-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" returned: 0 in 1.214s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:40 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07 Jul 09 17:14:40 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:40 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8" returned: 0 in 1.130s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:40 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8 Jul 09 17:14:40 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:40 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" returned: 0 in 0.794s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-5b250abe-cbeb-4ba0-8f42-a36215cc2a07" released by "delete_volume" :: held 2.053s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:41 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-025e4d8e-6f3c-4294-992e-d467b9ec11a8" returned: 0 in 0.693s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Created reservations ['000cadf3-cb98-4353-aea8-d473a1c02b4d', '6b1b5f12-96f5-4b09-9b34-532a83c2eac2', '83cf53c6-2faf-4075-9d2f-f24cc0272779', 'c1ce5821-b2ad-4ecc-9bd1-2dd139680a74'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-025e4d8e-6f3c-4294-992e-d467b9ec11a8" released by "delete_volume" :: held 1.895s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['3f9ddd8f-f4ec-47a0-b5eb-dec59d53b7b2', '98f020df-af57-468a-8dc2-e7f3d2bbe007', 'b3437a50-5514-4426-9d29-37adf96d0f87', '78184122-92b4-4988-8b24-c6708b49af4d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:41 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:41 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-f199d779-5fe0-4a89-96f2-c758f49a45a3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:41 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:41 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-f199d779-5fe0-4a89-96f2-c758f49a45a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-f199d779-5fe0-4a89-96f2-c758f49a45a3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-f199d779-5fe0-4a89-96f2-c758f49a45a3" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[98237f63-1a7f-43af-bada-9ca5c363e8a7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:41 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 Jul 09 17:14:41 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:42 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.945s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-625a3e62-6f37-4bfd-912b-832c57354a98 tempest-VolumesGetTest-176683340 None] Lock "cinder-5b250abe-cbeb-4ba0-8f42-a36215cc2a07-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-b162e3ab-c701-479b-a737-7bb151eb28af-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "cinder-b162e3ab-c701-479b-a737-7bb151eb28af-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-b162e3ab-c701-479b-a737-7bb151eb28af" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-b162e3ab-c701-479b-a737-7bb151eb28af" acquired by "delete_volume" :: waited 0.039s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ac97c-e6ec-4cdd-acc8-099c691ce3ba]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:42 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af Jul 09 17:14:42 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:42 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.611s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:42 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3" returned: 0 in 1.384s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:43 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3 Jul 09 17:14:43 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58a43651-1437-4995-b1c2-c53a3a21151b tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-025e4d8e-6f3c-4294-992e-d467b9ec11a8-delete_volume" released by "delete_volume" :: held 4.002s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:43 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f199d779-5fe0-4a89-96f2-c758f49a45a3" returned: 0 in 0.851s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:43 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-f199d779-5fe0-4a89-96f2-c758f49a45a3" released by "delete_volume" :: held 2.304s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af" returned: 0 in 1.295s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:43 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af Jul 09 17:14:43 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['10ebb8f2-6558-4c66-8345-4cc6be73dc42', 'e0248050-0d09-4333-8615-bc8aff7010c7', '05f1f7db-51fd-4c4f-84c2-82c3721ea1a5', '918ffeb9-6574-4178-a8d4-4bfa8582db06'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:44 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:44 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:44 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b162e3ab-c701-479b-a737-7bb151eb28af" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-b162e3ab-c701-479b-a737-7bb151eb28af" released by "delete_volume" :: held 2.275s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-9df62a1f-cdf3-44f5-b863-d8c97da8f772-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-9df62a1f-cdf3-44f5-b863-d8c97da8f772-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Created reservations ['c7b85eae-b36e-404e-84a1-10735065d690', 'b718cabc-204b-4bb3-8888-ecbaacae0254', '077ac1b4-907a-4bf3-9978-89b62ed069ea', '8facd949-7b00-4446-a6a1-8605cb665550'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:44 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.929s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-9df62a1f-cdf3-44f5-b863-d8c97da8f772" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:44 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-9df62a1f-cdf3-44f5-b863-d8c97da8f772" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3813215f-a6e8-4603-91ea-c0a76e60d6cd tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-f199d779-5fe0-4a89-96f2-c758f49a45a3-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ede196-2495-440b-8759-2c707d69b7f9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:45 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:45 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:45 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 Jul 09 17:14:45 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:46 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.989s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:46 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772" returned: 0 in 1.080s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:14:46 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772 Jul 09 17:14:46 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-903b37ca-986f-45ee-9eff-62ae9e656e3c tempest-VolumesGetTest-176683340 None] Lock "cinder-b162e3ab-c701-479b-a737-7bb151eb28af-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (9a51be70-a266-4fc3-b037-b11766c8595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34af73-e33a-4dbb-97e6-8db69c3adab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34af73-e33a-4dbb-97e6-8db69c3adab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-9787627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967e3bfb-8466-43e7-b31e-d25beb43f686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:47Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527bfc7-0dd8-40ca-87c5-fa530e4837a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527bfc7-0dd8-40ca-87c5-fa530e4837a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5437905-c6e5-4262-9808-9539e7f5ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5437905-c6e5-4262-9808-9539e7f5ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967e3bfb-8466-43e7-b31e-d25beb43f686', 'volume_name': 'volume-967e3bfb-8466-43e7-b31e-d25beb43f686', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd99d08-4db0-44cf-910b-4dce5001712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd99d08-4db0-44cf-910b-4dce5001712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a68f02-cf4f-4052-b024-1efe27261663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:46 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Volume 967e3bfb-8466-43e7-b31e-d25beb43f686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967e3bfb-8466-43e7-b31e-d25beb43f686', 'volume_size': 1} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-9787627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967e3bfb-8466-43e7-b31e-d25beb43f686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:47Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Creating volume 967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:14:46 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:46 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 1073741824 Jul 09 17:14:46 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:46 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9df62a1f-cdf3-44f5-b863-d8c97da8f772" returned: 0 in 0.784s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-9df62a1f-cdf3-44f5-b863-d8c97da8f772" released by "delete_volume" :: held 1.928s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['6a399374-f00a-46ea-926b-008b90ae96ad', '820b31df-7313-40ef-8fc4-3d126e13fe35', '3481ad0c-d3a9-4f9f-ac8c-fab8fbf85950', '4177203d-35f6-424f-91f9-3087f32db8e8'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:47 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:47 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-0df62aaa-3550-4af5-8489-d2eccbe127b8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-0df62aaa-3550-4af5-8489-d2eccbe127b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-0df62aaa-3550-4af5-8489-d2eccbe127b8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-0df62aaa-3550-4af5-8489-d2eccbe127b8" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a667c66-8736-4dc5-aa11-afa942b829b7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:47 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 Jul 09 17:14:47 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:47 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 1073741824" returned: 0 in 1.147s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:47 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:14:47 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:47 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.883s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:47 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-77ac585e-a40e-426c-8bc4-b5ca0e7d7fdb tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-9df62a1f-cdf3-44f5-b863-d8c97da8f772-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:48 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8" returned: 0 in 0.884s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:48 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8 Jul 09 17:14:48 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:48 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a68f02-cf4f-4052-b024-1efe27261663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967e3bfb-8466-43e7-b31e-d25beb43f686', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3417184d-cef8-4e4a-89c8-6b8d7a1998a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Volume volume-967e3bfb-8466-43e7-b31e-d25beb43f686 (967e3bfb-8466-43e7-b31e-d25beb43f686): created successfully Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3417184d-cef8-4e4a-89c8-6b8d7a1998a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (9a51be70-a266-4fc3-b037-b11766c8595c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-91429169-1e9c-430f-94bc-490c246e1f9d tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:14:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-6d8f3f8f-a5ad-4d6a-a896-066d6c2728a8 req-a00d0502-33ed-43bd-b6fd-ca855b383533 tempest-TestInstancesWithCinderVolumes-1248001463 None] Terminate volume connection completed successfully. Jul 09 17:14:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-6d8f3f8f-a5ad-4d6a-a896-066d6c2728a8 req-a00d0502-33ed-43bd-b6fd-ca855b383533 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleting attachment 3bc61c80-e710-4845-be4c-f51c67d27c53. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:14:49 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0df62aaa-3550-4af5-8489-d2eccbe127b8" returned: 0 in 0.766s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-0df62aaa-3550-4af5-8489-d2eccbe127b8" released by "delete_volume" :: held 1.743s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['3d8dde12-6345-4d1b-b222-6a8a4a9591c4', '2f4173aa-1c57-4a76-bdd1-28543b3121fb', '4fa6f592-16aa-4d08-899d-c3a559fbdc3d', 'a074231f-915e-481a-ad43-fdab629997d5'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:49 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:49 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-b5d03b48-e831-457b-9a95-4bd93034d8f4-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-b5d03b48-e831-457b-9a95-4bd93034d8f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-b5d03b48-e831-457b-9a95-4bd93034d8f4" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b5d03b48-e831-457b-9a95-4bd93034d8f4" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleting offline snapshot b5d03b48-e831-457b-9a95-4bd93034d8f4 of volume b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] snapshot_file for this snap is: volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d23700-3902-4a51-b680-a605250fb7a2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:49 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 Jul 09 17:14:50 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:50 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.938s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-aaeceba8-f4f2-4a1c-9f91-3b6b7800af03 tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-0df62aaa-3550-4af5-8489-d2eccbe127b8-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (068cd236-65f2-48ee-8e94-a3a2c166ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263b9878-a428-476c-8420-419994f2b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263b9878-a428-476c-8420-419994f2b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-740516529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163ce2be-7d5f-45ae-9191-f898cf800b15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=967e3bfb-8466-43e7-b31e-d25beb43f686,status='creating',terminated_at=None,updated_at=2026-07-09T15:14:50Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b99b61-57a1-4474-ae0d-423e329b97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b99b61-57a1-4474-ae0d-423e329b97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74c713f-a074-424a-99b6-7c0e6225f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74c713f-a074-424a-99b6-7c0e6225f379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '163ce2be-7d5f-45ae-9191-f898cf800b15', 'volume_name': 'volume-163ce2be-7d5f-45ae-9191-f898cf800b15', 'volume_size': 1, 'source_volid': '967e3bfb-8466-43e7-b31e-d25beb43f686', 'source_volstatus': 'available'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1346a-707e-4fb1-be9b-859c139ddaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1346a-707e-4fb1-be9b-859c139ddaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32ef090-836e-492c-9c08-0a04d3c53320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:14:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Volume 163ce2be-7d5f-45ae-9191-f898cf800b15: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-163ce2be-7d5f-45ae-9191-f898cf800b15', 'volume_size': 1, 'source_volid': '967e3bfb-8466-43e7-b31e-d25beb43f686', 'source_volstatus': 'available'} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:50 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Cloning volume 967e3bfb-8466-43e7-b31e-d25beb43f686 to volume 163ce2be-7d5f-45ae-9191-f898cf800b15 Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Creating offline snapshot 6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 of volume 967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f1ed5-c467-406e-ad47-a3789056c425]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:50 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:14:50 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:50 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4" returned: 0 in 1.001s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bb7be2-140f-47fc-9d9d-224a831c584c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-553002a3-6f8b-425d-b7ec-792447decb66-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:51 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c Jul 09 17:14:51 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-553002a3-6f8b-425d-b7ec-792447decb66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-quobyte-553002a3-6f8b-425d-b7ec-792447decb66" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-553002a3-6f8b-425d-b7ec-792447decb66" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb26d2c-5d5a-490b-94dc-c2ac44625857]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:51 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 Jul 09 17:14:51 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:51 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 1.066s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:51 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 1G Jul 09 17:14:51 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:52 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" returned: 0 in 1.535s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:52 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 Jul 09 17:14:52 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:52 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66" returned: 0 in 1.363s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:52 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66 Jul 09 17:14:52 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:53 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 1G" returned: 0 in 1.768s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e3bfb-8466-43e7-b31e-d25beb43f686 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:53 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e3bfb-8466-43e7-b31e-d25beb43f686 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:14:53 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:53 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-553002a3-6f8b-425d-b7ec-792447decb66" returned: 0 in 1.220s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-553002a3-6f8b-425d-b7ec-792447decb66" released by "delete_volume" :: held 2.638s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:53 devstack cinder-volume[86876]: WARNING cinder.quota [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056646784-2098081258 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056646784-2098081258, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:14:53 devstack cinder-volume[86876]: WARNING cinder.quota [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056646784-2098081258 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056646784-2098081258, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Created reservations ['45af7a77-547f-4645-814b-533721e98ff5', 'f659b7d8-95f4-43ff-b440-17253044f0d3', '9a12124a-1522-4e49-844d-111719a639bb', '866fffc1-0fe9-49ce-a617-461b95a7de3e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:54 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4" returned: 0 in 1.587s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:54 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4 Jul 09 17:14:54 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:54 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:54 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:54 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e3bfb-8466-43e7-b31e-d25beb43f686 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 1.058s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 is being set with open permissions: ugo+rw Jul 09 17:14:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:54 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:14:54 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:55 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c.b5d03b48-e831-457b-9a95-4bd93034d8f4" returned: 0 in 1.139s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b5d03b48-e831-457b-9a95-4bd93034d8f4" released by "_delete_snapshot" :: held 5.496s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" released by "delete_snapshot" :: held 5.550s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:55 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.164s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleted volume successfully. Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-85c36e7f-2cd8-4d53-891f-ddcbaa135e66 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-553002a3-6f8b-425d-b7ec-792447decb66-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['f9f9d489-95ee-49ca-b3e8-3d0c09c7c35e', '85633363-8c01-4682-91ee-7fca5e577ed3', '162a32e1-0cc5-4513-9295-9e230e82c567', '52be4af8-ceea-4a44-9fd1-b7ad49031a9a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Delete snapshot completed successfully. Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bbb0bf85-e878-4bcc-9e32-4a854e053d5e tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-b5d03b48-e831-457b-9a95-4bd93034d8f4-delete_snapshot" released by "delete_snapshot" :: held 5.882s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:55 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 1.072s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:55 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info Jul 09 17:14:55 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8096e4-71a9-4e98-9a05-dfa1195e590e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:56 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c Jul 09 17:14:56 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:56 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info" returned: 0 in 0.894s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:56 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info is being set with open permissions: ugo+rw Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:56 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info Jul 09 17:14:56 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-cf86f298-27b4-41c3-b227-21efeb93a88d req-9df272ff-61aa-4c86-8bda-8efa9cc39a61 tempest-TestInstancesWithCinderVolumes-1248001463 None] Terminate volume connection completed successfully. Jul 09 17:14:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-cf86f298-27b4-41c3-b227-21efeb93a88d req-9df272ff-61aa-4c86-8bda-8efa9cc39a61 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleting attachment 20cedbfc-a594-4187-affa-679f21da8978. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:14:57 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" returned: 0 in 0.860s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:57 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c Jul 09 17:14:57 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:57 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.info" returned: 0 in 0.751s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] snapshot: 6aac6b42-e4dd-4f59-9098-6bde1a8b02a1, volume: 163ce2be-7d5f-45ae-9191-f898cf800b15, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c6d9c-b2f9-446f-aab7-34282434b6a2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:57 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:14:57 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:57 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" returned: 0 in 0.756s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-quobyte-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c" released by "delete_volume" :: held 1.696s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Created reservations ['399ebba8-e0f7-4436-960a-288ac3900760', 'e012a633-ad7b-4470-bb4b-b1c2d3384e81', 'fae4d6f6-6e47-423b-9912-5b31d3672c9b', 'b0932c53-c372-45e8-a179-7cccd67fc15b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:58 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:14:58 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:58 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 0.858s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967e3bfb-8466-43e7-b31e-d25beb43f686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[15538c18-f8a9-4b64-bf44-fea8979bf620]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:58 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:14:58 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-e10dd552-ca63-4342-a4bc-4927e3b09979-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:58 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-e10dd552-ca63-4342-a4bc-4927e3b09979-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.893s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:14:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Deleted volume successfully. Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1fd83f13-1523-433a-bab5-ec3c8d71f81d tempest-CreateVolumesFromSnapshotTest-641413104 None] Lock "cinder-b3e823f3-80d2-4b71-a8a1-ee601a62aa1c-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-quobyte-e10dd552-ca63-4342-a4bc-4927e3b09979" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-e10dd552-ca63-4342-a4bc-4927e3b09979" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8077415-8dd1-479a-bb0a-1d5c73a74175]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:59 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 Jul 09 17:14:59 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:14:59 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 1.075s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:14:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:14:59 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 Jul 09 17:14:59 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:00 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979" returned: 0 in 1.157s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:00 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979 Jul 09 17:15:00 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:00 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:00 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:02 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e10dd552-ca63-4342-a4bc-4927e3b09979" returned: 0 in 2.281s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-e10dd552-ca63-4342-a4bc-4927e3b09979" released by "delete_volume" :: held 3.557s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:02 devstack cinder-volume[86876]: WARNING cinder.quota [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125362263-662595506 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125362263-662595506, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:15:02 devstack cinder-volume[86876]: WARNING cinder.quota [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125362263-662595506 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125362263-662595506, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:15:02 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Created reservations ['f5006cf4-3f2d-4f58-b3dc-745ab0375fc1', '412bd224-da37-4164-9a4d-b27b00da1991', '77390f02-2536-4a2e-916a-9e86d6e88071', '61853e0a-f033-42f5-9b2f-19bab57962da'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:03 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 2.560s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:03 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 28 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:15:03 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:15:04 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.555s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:04 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:04 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleted volume successfully. Jul 09 17:15:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e5769c4-f23e-445d-a0da-ecc5fff9ab26 tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-e10dd552-ca63-4342-a4bc-4927e3b09979-delete_volume" released by "delete_volume" :: held 5.804s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (9263bf2c-be43-4d68-9787-b4163c838669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93dc864c-4cbc-4d36-9d79-14f501d63f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93dc864c-4cbc-4d36-9d79-14f501d63f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900511930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53a44fb-b56e-46ad-9f0c-58cb282ddfff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:07Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb0da42-c6a7-4096-ab6f-bd66364e505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb0da42-c6a7-4096-ab6f-bd66364e505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4422d9be-52bd-4cc9-94e7-3f235d997ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4422d9be-52bd-4cc9-94e7-3f235d997ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53a44fb-b56e-46ad-9f0c-58cb282ddfff', 'volume_name': 'volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b56e738-eb35-4209-90f0-df88580ac6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b56e738-eb35-4209-90f0-df88580ac6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71d17e5-b91f-4bf3-9a81-916213fd056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:06 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume a53a44fb-b56e-46ad-9f0c-58cb282ddfff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff', 'volume_size': 1} Jul 09 17:15:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:07 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15" returned: 0 in 7.691s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ee1c9-e290-4b80-8221-e5959a83e4dd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:07 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:15:07 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:08 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 1.129s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:08 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:15:08 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Converted 1024.00 MB image at 133.12 MB/s Jul 09 17:15:08 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 is being set with open permissions: ugo+rw Jul 09 17:15:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:08 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 Jul 09 17:15:08 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:09 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15" returned: 0 in 0.909s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" released by "_copy_volume_from_snapshot" :: held 11.783s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Deleting offline snapshot 6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 of volume 967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] snapshot_file for this snap is: volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd7e090-bd78-45d2-8c31-ff63661d4e5f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:09 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:15:09 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:10 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 0.972s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967e3bfb-8466-43e7-b31e-d25beb43f686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:15:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a2594-a6df-4f9b-a044-9fafbbface8a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:10 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:15:10 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-0d370a62-1392-41e7-ba70-3e5df10a6af2 req-a56cee38-ebd7-4594-83d4-82fa970254a9 tempest-TestInstancesWithCinderVolumes-1248001463 None] Terminate volume connection completed successfully. Jul 09 17:15:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-0d370a62-1392-41e7-ba70-3e5df10a6af2 req-a56cee38-ebd7-4594-83d4-82fa970254a9 tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleting attachment 7858e8fc-6935-4bba-a739-6302bc5b6b08. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:15:11 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 1.162s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:11 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:15:11 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:12 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:12 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1 Jul 09 17:15:12 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:13 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686.6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" returned: 0 in 0.699s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-6aac6b42-e4dd-4f59-9098-6bde1a8b02a1" released by "_delete_snapshot" :: held 3.768s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.569s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.375s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900511930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53a44fb-b56e-46ad-9f0c-58cb282ddfff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:07Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume a53a44fb-b56e-46ad-9f0c-58cb282ddfff {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:13 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:13 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff 1073741824 Jul 09 17:15:13 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32ef090-836e-492c-9c08-0a04d3c53320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163ce2be-7d5f-45ae-9191-f898cf800b15', 'volume_size': 1, 'source_volid': '967e3bfb-8466-43e7-b31e-d25beb43f686', 'source_volstatus': 'available'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca77eb-f84d-49cc-857e-67d3a1c45d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Volume volume-163ce2be-7d5f-45ae-9191-f898cf800b15 (163ce2be-7d5f-45ae-9191-f898cf800b15): created successfully Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca77eb-f84d-49cc-857e-67d3a1c45d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (068cd236-65f2-48ee-8e94-a3a2c166ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1dce6609-2e65-491a-9686-32224231965d tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:15:14 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff 1073741824" returned: 0 in 1.055s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:14 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff Jul 09 17:15:14 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-99ba1a04-1c45-4739-8b86-58aef6a115d4-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-99ba1a04-1c45-4739-8b86-58aef6a115d4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "cinder-quobyte-99ba1a04-1c45-4739-8b86-58aef6a115d4" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (cdd30a9e-8cc7-47d9-8c2b-cd375aa31ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3decc23-2c0a-46bb-8f72-9dae9149de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-99ba1a04-1c45-4739-8b86-58aef6a115d4" acquired by "delete_volume" :: waited 0.059s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" returned: 0 in 1.173s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3decc23-2c0a-46bb-8f72-9dae9149de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-173859258',display_name='tempest-VolumesGetTest-Volume-262780985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee09f2b-57ac-4145-ae44-a031a158d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:15Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13a4d0-d280-4604-9cdb-a6b71751e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13a4d0-d280-4604-9cdb-a6b71751e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492fef5-48b7-4c02-9062-34add122685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492fef5-48b7-4c02-9062-34add122685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee09f2b-57ac-4145-ae44-a031a158d8e2', 'volume_name': 'volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681f8b7a-6cf1-4c51-814e-a64ecd1e1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681f8b7a-6cf1-4c51-814e-a64ecd1e1b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3282a7-c9ba-4b65-87a5-5ce79e4ef33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Volume 0ee09f2b-57ac-4145-ae44-a031a158d8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2', 'volume_size': 1} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-173859258',display_name='tempest-VolumesGetTest-Volume-262780985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee09f2b-57ac-4145-ae44-a031a158d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:15Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Creating volume 0ee09f2b-57ac-4145-ae44-a031a158d8e2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:15 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb45f2-7f82-47a8-82ff-760b0b3550f9]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:15 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 1073741824 Jul 09 17:15:15 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71d17e5-b91f-4bf3-9a81-916213fd056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feffc0c-484b-4c57-a9be-3959421035b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff (a53a44fb-b56e-46ad-9f0c-58cb282ddfff): created successfully Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feffc0c-484b-4c57-a9be-3959421035b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (9263bf2c-be43-4d68-9787-b4163c838669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a23e0f77-d450-4830-ac42-924ab53b84f8 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:15 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:15:15 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (c8085730-1c7a-4fdd-81e5-56b0e73d526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5840b52-927b-4198-be90-7d2c6dc51f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:16 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 1.136s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5840b52-927b-4198-be90-7d2c6dc51f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304390808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb623b93-d185-4d55-a1f1-ba4eedce6740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:17Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53e3fc3-5ed6-4ba2-bb9e-31285049246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53e3fc3-5ed6-4ba2-bb9e-31285049246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6259708-5bff-40ed-acb7-74b5310f7ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6259708-5bff-40ed-acb7-74b5310f7ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb623b93-d185-4d55-a1f1-ba4eedce6740', 'volume_name': 'volume-cb623b93-d185-4d55-a1f1-ba4eedce6740', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1c1727-1cdf-4706-a64c-b58a19b61083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1c1727-1cdf-4706-a64c-b58a19b61083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b948fbb3-9afe-44bb-b148-967fe15714aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Volume cb623b93-d185-4d55-a1f1-ba4eedce6740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb623b93-d185-4d55-a1f1-ba4eedce6740', 'volume_size': 1} Jul 09 17:15:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:16 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:15:16 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (40028027-53a3-45f1-9de0-775f280dfbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673ebe4d-0d96-40bf-8b76-60aed5cbf383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673ebe4d-0d96-40bf-8b76-60aed5cbf383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419955675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76e67ad-c582-4d22-a5fc-f11e345b8aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:17Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f6d213-e2ff-442a-b0a6-0278b2d4b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:17 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f6d213-e2ff-442a-b0a6-0278b2d4b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b71ad3-7b85-47d1-b45c-bea9739f0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b71ad3-7b85-47d1-b45c-bea9739f0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76e67ad-c582-4d22-a5fc-f11e345b8aba', 'volume_name': 'volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a895c7a-6396-435a-8841-d46d5d9cfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a895c7a-6396-435a-8841-d46d5d9cfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e98b608-7c31-4db4-a9a5-35d0427c4a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume a76e67ad-c582-4d22-a5fc-f11e345b8aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba', 'volume_size': 1} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 1073741824" returned: 0 in 1.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:17 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 Jul 09 17:15:17 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (ac74054c-5701-4ab2-b28a-dd28993e795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:18 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83682329-9df1-4871-96f4-6f3389e03e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 1 in 1.258s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83682329-9df1-4871-96f4-6f3389e03e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984417397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99376d26-5379-42a4-aead-29928ddfdba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:18Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4 Jul 09 17:15:18 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e7ded7-98df-476e-946a-72cbf87df720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e7ded7-98df-476e-946a-72cbf87df720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49634b92-4e1c-422d-bcdd-61269fc8ef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49634b92-4e1c-422d-bcdd-61269fc8ef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99376d26-5379-42a4-aead-29928ddfdba0', 'volume_name': 'volume-99376d26-5379-42a4-aead-29928ddfdba0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937cd053-0786-491d-8ac9-c7f8d577bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937cd053-0786-491d-8ac9-c7f8d577bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a24dee3-6fb6-473d-812e-730ac57c21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume 99376d26-5379-42a4-aead-29928ddfdba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99376d26-5379-42a4-aead-29928ddfdba0', 'volume_size': 1} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (713a4fa4-319d-4071-b8d4-4199ba3bd28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ecd9a8-e93d-4d94-ab59-b13c1a050cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2" returned: 0 in 1.157s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] <== create_volume: return (2885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.888s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304390808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb623b93-d185-4d55-a1f1-ba4eedce6740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:17Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Creating volume cb623b93-d185-4d55-a1f1-ba4eedce6740 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:18 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ecd9a8-e93d-4d94-ab59-b13c1a050cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309587939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2309f75e-9028-435d-a362-8489f0ca94c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:18Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce686e0d-998b-4afa-8e90-2def20886ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce686e0d-998b-4afa-8e90-2def20886ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 1073741824 Jul 09 17:15:18 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c6808b-cea6-4681-b9a2-6d3ced1da0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c6808b-cea6-4681-b9a2-6d3ced1da0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2309f75e-9028-435d-a362-8489f0ca94c3', 'volume_name': 'volume-2309f75e-9028-435d-a362-8489f0ca94c3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e5435-3d88-4f61-9536-9a3b595a39ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e5435-3d88-4f61-9536-9a3b595a39ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9d3a98-72b2-4665-815c-fff4b1339903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume 2309f75e-9028-435d-a362-8489f0ca94c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2309f75e-9028-435d-a362-8489f0ca94c3', 'volume_size': 1} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3282a7-c9ba-4b65-87a5-5ce79e4ef33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4b1bb7-f9b8-418b-aba5-8b95730d4002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Volume volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 (0ee09f2b-57ac-4145-ae44-a031a158d8e2): created successfully Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4b1bb7-f9b8-418b-aba5-8b95730d4002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (cdd30a9e-8cc7-47d9-8c2b-cd375aa31ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-46375bf1-40f0-4383-bad1-d77b41a65bd7 tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (f286070f-fd07-41dd-83fc-ee032294d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a154a-47b4-4b9f-99eb-d07abdfd7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a154a-47b4-4b9f-99eb-d07abdfd7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23343626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1ebb3-fdba-4047-87ce-5845d04111d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:19Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5ae24-4307-46ba-b46b-f3d89bbdd9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5ae24-4307-46ba-b46b-f3d89bbdd9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8617e64-0491-4807-af23-cf947fd05202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8617e64-0491-4807-af23-cf947fd05202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d1ebb3-fdba-4047-87ce-5845d04111d2', 'volume_name': 'volume-22d1ebb3-fdba-4047-87ce-5845d04111d2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739cf884-d24e-46da-a494-a9908c01d226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739cf884-d24e-46da-a494-a9908c01d226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe85d1-d33c-4698-b9b7-133afb28ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume 22d1ebb3-fdba-4047-87ce-5845d04111d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d1ebb3-fdba-4047-87ce-5845d04111d2', 'volume_size': 1} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99ba1a04-1c45-4739-8b86-58aef6a115d4" returned: 0 in 1.225s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-quobyte-99ba1a04-1c45-4739-8b86-58aef6a115d4" released by "delete_volume" :: held 3.774s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:19 devstack cinder-volume[86876]: WARNING cinder.quota [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1376889000-1495773801 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1376889000-1495773801, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:15:19 devstack cinder-volume[86876]: WARNING cinder.quota [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1376889000-1495773801 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1376889000-1495773801, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Created reservations ['15b8823a-e227-4dbd-a685-04712dd39e75', '1d7b042f-760e-4ccd-b489-37344339a0e9', '977e075d-22e1-4855-96ed-79c0e4d16fec', '7e6bc23e-c999-4498-9325-af4a41004c4f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:19 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:19 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (eb9d5f4f-ae54-47fe-bf70-0d9efff30682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d8a87a-4c2a-4004-9161-9b50aad37905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d8a87a-4c2a-4004-9161-9b50aad37905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809205213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:20Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e096798-1758-496a-8aec-8291f8464df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e096798-1758-496a-8aec-8291f8464df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef3d00-3325-48b8-95a2-a7cf92925785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef3d00-3325-48b8-95a2-a7cf92925785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4', 'volume_name': 'volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a9ba6-b21e-4fc7-9ac2-903016789fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a9ba6-b21e-4fc7-9ac2-903016789fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b2aa0f-9c98-4a33-b11e-dbe4bfab5e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume 8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4', 'volume_size': 1} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 1073741824" returned: 0 in 1.423s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:20 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 Jul 09 17:15:20 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-0ee09f2b-57ac-4145-ae44-a031a158d8e2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "cinder-0ee09f2b-57ac-4145-ae44-a031a158d8e2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-0ee09f2b-57ac-4145-ae44-a031a158d8e2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-0ee09f2b-57ac-4145-ae44-a031a158d8e2" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0f344-6342-4f65-adde-3a3fcb752db5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:20 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.025s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Deleted volume successfully. Jul 09 17:15:20 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 Jul 09 17:15:20 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-514d7f40-099d-45d7-8c63-401abe89a99b tempest-TestInstancesWithCinderVolumes-1248001463 None] Lock "cinder-99ba1a04-1c45-4739-8b86-58aef6a115d4-delete_volume" released by "delete_volume" :: held 5.327s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:21 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740" returned: 0 in 1.128s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (2676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.682s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.893s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419955675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76e67ad-c582-4d22-a5fc-f11e345b8aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:17Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume a76e67ad-c582-4d22-a5fc-f11e345b8aba {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:21 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b948fbb3-9afe-44bb-b148-967fe15714aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb623b93-d185-4d55-a1f1-ba4eedce6740', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:21 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba 1073741824 Jul 09 17:15:21 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bf6d3b-feb3-4d5d-882e-676d226e996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Volume volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 (cb623b93-d185-4d55-a1f1-ba4eedce6740): created successfully Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bf6d3b-feb3-4d5d-882e-676d226e996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (c8085730-1c7a-4fdd-81e5-56b0e73d526d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6af4d0c9-1af4-464d-a6a3-09ca06fc4622 tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:15:21 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2" returned: 0 in 1.060s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:21 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2 Jul 09 17:15:21 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c8933ab-b6eb-4f0b-87cf-45880e111fb3 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740" by "attach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c8933ab-b6eb-4f0b-87cf-45880e111fb3 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740" acquired by "attach_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2c8933ab-b6eb-4f0b-87cf-45880e111fb3 tempest-VolumesActionsTest-1077975118 None] Attaching volume cb623b93-d185-4d55-a1f1-ba4eedce6740 to instance 4e70a2ce-dc4a-4afd-b323-37b377d6820e at mountpoint /dev/vdb on host None. Jul 09 17:15:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2c8933ab-b6eb-4f0b-87cf-45880e111fb3 tempest-VolumesActionsTest-1077975118 None] Attach volume completed successfully. Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c8933ab-b6eb-4f0b-87cf-45880e111fb3 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740" released by "attach_volume" :: held 0.168s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:22 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0ee09f2b-57ac-4145-ae44-a031a158d8e2" returned: 0 in 0.906s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:22 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba 1073741824" returned: 0 in 1.178s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-0ee09f2b-57ac-4145-ae44-a031a158d8e2" released by "delete_volume" :: held 2.042s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:22 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba Jul 09 17:15:22 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Created reservations ['e6ef6b2d-cb86-4160-b608-fdc82ec67ec0', 'b81cff25-cda9-4721-8f08-376c8d57f703', 'f3222947-dede-4c67-9f2e-e25a9d52da67', 'a487f927-62ad-4838-8a00-d6136af46b5f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:22 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:22 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Terminate volume connection completed successfully. Jul 09 17:15:23 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.947s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-63d21a66-883d-4ce5-ae27-582385db0690 tempest-VolumesGetTest-176683340 None] Lock "cinder-0ee09f2b-57ac-4145-ae44-a031a158d8e2-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:23 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba" returned: 0 in 1.367s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.705s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984417397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99376d26-5379-42a4-aead-29928ddfdba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:18Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume 99376d26-5379-42a4-aead-29928ddfdba0 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:23 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-163ce2be-7d5f-45ae-9191-f898cf800b15-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e98b608-7c31-4db4-a9a5-35d0427c4a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:23 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 1073741824 Jul 09 17:15:23 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ef3eb-1cd4-40d0-81b9-9a9ff15236ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "cinder-163ce2be-7d5f-45ae-9191-f898cf800b15-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba (a76e67ad-c582-4d22-a5fc-f11e345b8aba): created successfully Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ef3eb-1cd4-40d0-81b9-9a9ff15236ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (40028027-53a3-45f1-9de0-775f280dfbdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ffc634a4-a493-4898-9e63-75a916f040bc tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" by "detach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c9774-2a04-4f57-8f5a-2fabd3e9e991]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Detaching volume cb623b93-d185-4d55-a1f1-ba4eedce6740 from instance 4e70a2ce-dc4a-4afd-b323-37b377d6820e. Jul 09 17:15:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Detach volume completed successfully. Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-6e7a6a02-9c02-4034-9d39-2372dc7072ee tempest-VolumesActionsTest-2042775929 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:24 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 Jul 09 17:15:24 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cab39627-1370-41c6-a0c0-5ac87e65073d tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" by "detach_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cab39627-1370-41c6-a0c0-5ac87e65073d tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-cab39627-1370-41c6-a0c0-5ac87e65073d tempest-VolumesActionsTest-1077975118 None] Volume detach called, but volume not attached. Jul 09 17:15:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-cab39627-1370-41c6-a0c0-5ac87e65073d tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:25 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15" returned: 0 in 0.937s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:25 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15 Jul 09 17:15:25 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:25 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 1073741824" returned: 0 in 1.452s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:25 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 Jul 09 17:15:25 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-quobyte-cb623b93-d185-4d55-a1f1-ba4eedce6740" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "cinder-quobyte-cb623b93-d185-4d55-a1f1-ba4eedce6740" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679658e-3e2a-4025-8138-4d6f0bd33f19]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:25 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-163ce2be-7d5f-45ae-9191-f898cf800b15" returned: 0 in 0.958s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-163ce2be-7d5f-45ae-9191-f898cf800b15" released by "delete_volume" :: held 2.000s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Created reservations ['31c16744-4676-49a8-958c-e5ae5b7cd0b9', '2b9180e4-d54b-4ec3-a81b-277c76bdd8c4', '9140a6e6-e612-43b9-aa9c-14c8d4edf15a', '6e74383f-89e9-4cc5-ac25-73f99b3077b8'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:26 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 Jul 09 17:15:26 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:26 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:26 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-967e3bfb-8466-43e7-b31e-d25beb43f686-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "cinder-967e3bfb-8466-43e7-b31e-d25beb43f686-delete_volume" acquired by "delete_volume" :: waited 0.176s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:26 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0" returned: 0 in 1.440s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.164s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309587939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2309f75e-9028-435d-a362-8489f0ca94c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:18Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume 2309f75e-9028-435d-a362-8489f0ca94c3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:26 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:26 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 1073741824 Jul 09 17:15:26 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a24dee3-6fb6-473d-812e-730ac57c21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99376d26-5379-42a4-aead-29928ddfdba0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee10c8d-4229-4527-add6-3be5e9cf1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-967e3bfb-8466-43e7-b31e-d25beb43f686" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-99376d26-5379-42a4-aead-29928ddfdba0 (99376d26-5379-42a4-aead-29928ddfdba0): created successfully Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee10c8d-4229-4527-add6-3be5e9cf1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (ac74054c-5701-4ab2-b28a-dd28993e795c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-967e3bfb-8466-43e7-b31e-d25beb43f686" acquired by "delete_volume" :: waited 0.110s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-476995eb-48cc-4c17-aacb-2267f4369e30 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef84055-8e95-478b-a6d9-a6fdeb8ec5c3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:27 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:15:27 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:27 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740" returned: 0 in 1.441s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:27 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740 Jul 09 17:15:27 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:27 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.184s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:15:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9ba606af-93c0-4f42-8f5b-8970630f305a tempest-VolumesGetTest-176683340 None] Lock "cinder-163ce2be-7d5f-45ae-9191-f898cf800b15-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:28 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 1073741824" returned: 0 in 1.251s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:28 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 Jul 09 17:15:28 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:28 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 1.186s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:28 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686 Jul 09 17:15:28 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:28 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-cb623b93-d185-4d55-a1f1-ba4eedce6740" returned: 0 in 1.084s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "cinder-quobyte-cb623b93-d185-4d55-a1f1-ba4eedce6740" released by "delete_volume" :: held 2.599s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Created reservations ['f8324a1c-d5ad-42b0-8fc2-dea181764ab5', '204ebd22-7e6f-4b55-83d2-ff0c93dfcd12', '61d8a496-941c-4ec9-b6cb-6c90bcee24e4', '17c70577-9653-46a7-b3ee-f2022c38e6aa'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:28 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:28 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:28 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3" returned: 0 in 0.845s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.741s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23343626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1ebb3-fdba-4047-87ce-5845d04111d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:19Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume 22d1ebb3-fdba-4047-87ce-5845d04111d2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:28 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9d3a98-72b2-4665-815c-fff4b1339903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2309f75e-9028-435d-a362-8489f0ca94c3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:29 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 1073741824 Jul 09 17:15:29 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4f3ef5-64c3-4558-94f1-fef042b2588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-2309f75e-9028-435d-a362-8489f0ca94c3 (2309f75e-9028-435d-a362-8489f0ca94c3): created successfully Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4f3ef5-64c3-4558-94f1-fef042b2588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (713a4fa4-319d-4071-b8d4-4199ba3bd28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f3136d89-3b7e-426e-a189-ac0f9b382334 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:29 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-967e3bfb-8466-43e7-b31e-d25beb43f686" returned: 0 in 0.939s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-967e3bfb-8466-43e7-b31e-d25beb43f686" released by "delete_volume" :: held 2.254s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Created reservations ['ae3b49f5-1f81-4d4b-bdd7-d2e9a78bd3f6', '31fa7d8d-6d38-4633-9ffc-5553f42bcaf0', '3aabf41d-30a5-4f3b-a378-cce42bdf7d50', '87ea954f-5428-408a-9943-6b3daf7e8480'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:29 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:29 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:29 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.977s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Deleted volume successfully. Jul 09 17:15:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fbc4983-b200-47d2-8d1f-2c919d2968fa tempest-VolumesActionsTest-1077975118 None] Lock "cinder-cb623b93-d185-4d55-a1f1-ba4eedce6740-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:30 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 1073741824" returned: 0 in 1.291s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:30 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 Jul 09 17:15:30 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:30 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.913s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-54ec094a-d6ee-4016-b921-7b31b0e3bbd6 tempest-VolumesGetTest-176683340 None] Lock "cinder-967e3bfb-8466-43e7-b31e-d25beb43f686-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (d31c4336-866c-487c-ba1e-4c730d7a633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4290a7-b0b8-4100-b145-3497979e25b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4290a7-b0b8-4100-b145-3497979e25b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2060015676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aacbdead-eb9b-44fc-b007-52161576f486,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:31Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67bca3e-9408-48b0-a833-679dd5dbe66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67bca3e-9408-48b0-a833-679dd5dbe66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637bbac7-1b3f-4978-b2c8-c629293bbb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:30 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:15:31 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.167s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809205213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a441e8591c642acbf50a33575e8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:20Z,use_quota=True,user_id='49abb73b4d7445a78904afa4affad01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Creating volume 8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:31 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:31 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 1073741824 Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe85d1-d33c-4698-b9b7-133afb28ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d1ebb3-fdba-4047-87ce-5845d04111d2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:31 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee370e1-aceb-4566-87a8-b90de27e0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 (22d1ebb3-fdba-4047-87ce-5845d04111d2): created successfully Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee370e1-aceb-4566-87a8-b90de27e0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (f286070f-fd07-41dd-83fc-ee032294d10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c09c34bf-145f-4582-81f9-13d97ebc3097 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637bbac7-1b3f-4978-b2c8-c629293bbb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aacbdead-eb9b-44fc-b007-52161576f486', 'volume_name': 'volume-aacbdead-eb9b-44fc-b007-52161576f486', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39a32e8-d7b7-4acc-9792-d4695acf8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39a32e8-d7b7-4acc-9792-d4695acf8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215948d8-a515-44aa-aa41-ea8852c8354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Volume aacbdead-eb9b-44fc-b007-52161576f486: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aacbdead-eb9b-44fc-b007-52161576f486', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 17:15:31 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Trying to clone aacbdead-eb9b-44fc-b007-52161576f486 from image cd66455c-9772-4d79-b400-0ea9cf463a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:15:32 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:15:32 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Image download 20.69 MB at 20.69 MB/s Jul 09 17:15:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec5f8f-d523-44f5-8d4c-6d42b280142c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:32 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD Jul 09 17:15:32 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:32 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 1073741824" returned: 0 in 1.633s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:32 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 Jul 09 17:15:32 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:33 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD" returned: 0 in 1.051s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 is fetched for user 582058698e0c4c9c857de1948805811a. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=164,cinder:DELETE=13,cinder:SELECT=128,cinder:INSERT=42 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=173,cinder:DELETE=14 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e0639d-9cb1-4d6f-bc9d-4548719c190f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:33 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b2aa0f-9c98-4a33-b11e-dbe4bfab5e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9a0ba8-1867-4f8c-a615-b9841e44e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Volume volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 (8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4): created successfully Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9a0ba8-1867-4f8c-a615-b9841e44e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Flow 'volume_create_manager' (eb9d5f4f-ae54-47fe-bf70-0d9efff30682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-abe61bc8-5ff3-4552-9143-0a5f5258e4c4 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created volume successfully. Jul 09 17:15:33 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD Jul 09 17:15:33 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:34 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2060015676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aacbdead-eb9b-44fc-b007-52161576f486,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:31Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Creating volume aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:34 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:34 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1073741824 Jul 09 17:15:34 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[321aa0c3-8959-417d-b07e-d5eb1c3650cd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:34 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 Jul 09 17:15:34 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:35 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1073741824" returned: 0 in 1.029s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:35 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:35 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:35 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:35 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4 Jul 09 17:15:35 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:36 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:36 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" returned: 0 in 0.711s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4" released by "delete_volume" :: held 1.628s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Attempting download of cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume aacbdead-eb9b-44fc-b007-52161576f486. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['ee7d617d-3ef1-4de8-8ced-cb3e85a50826', 'ee8cf20d-6c94-4c33-ae90-f6295d398c7a', 'ba9ea75a-ca00-4557-b532-ef52a7824141', 'e322b59a-97fd-4ba6-a661-7bba2e909c07'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e2e35-2307-4c0f-a834-f8fe4f41f350]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:36 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:36 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:36 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w Jul 09 17:15:36 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-22d1ebb3-fdba-4047-87ce-5845d04111d2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-22d1ebb3-fdba-4047-87ce-5845d04111d2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-22d1ebb3-fdba-4047-87ce-5845d04111d2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-22d1ebb3-fdba-4047-87ce-5845d04111d2" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99cac23-cdb8-4ef8-bc9f-7375ef8d192c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:37 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 Jul 09 17:15:37 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (c6a3aec6-563c-46b4-8783-e41cde5534c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad52917-bd16-45b7-b99d-267f8ad61b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad52917-bd16-45b7-b99d-267f8ad61b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448498616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a674f4e9-5462-4787-8fb5-2a5521a2c683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:37Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1687dd1b-d11d-471e-aad9-0bfb5137a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1687dd1b-d11d-471e-aad9-0bfb5137a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d04de1-c9bf-42fe-862a-4a064dc8dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:37 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d04de1-c9bf-42fe-862a-4a064dc8dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a674f4e9-5462-4787-8fb5-2a5521a2c683', 'volume_name': 'volume-a674f4e9-5462-4787-8fb5-2a5521a2c683', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0218df96-bca4-4dfe-a004-1b5eda999cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0218df96-bca4-4dfe-a004-1b5eda999cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c62d59-0841-44e8-a5b5-8760be983b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Volume a674f4e9-5462-4787-8fb5-2a5521a2c683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a674f4e9-5462-4787-8fb5-2a5521a2c683', 'volume_size': 1} Jul 09 17:15:37 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448498616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a674f4e9-5462-4787-8fb5-2a5521a2c683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:37Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Creating volume a674f4e9-5462-4787-8fb5-2a5521a2c683 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w" returned: 0 in 1.076s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.025s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:37 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 1073741824 Jul 09 17:15:37 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f1ea37f9-0978-4bc0-8b44-62ca0daaa434 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-8e6eed2d-de0a-40af-ae2a-0d9387e0fbe4-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:37 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w Jul 09 17:15:37 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:38 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2" returned: 0 in 1.032s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:38 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2 Jul 09 17:15:38 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:38 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w" returned: 1 in 0.889s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd66455c-9772-4d79-b400-0ea9cf463a75_dxvq3a2w' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e6ed3-39b0-40e7-b756-a33b11af1e7c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:38 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 1073741824" returned: 0 in 0.991s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:38 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD Jul 09 17:15:38 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:38 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 Jul 09 17:15:38 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:38 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-22d1ebb3-fdba-4047-87ce-5845d04111d2" returned: 0 in 0.772s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-22d1ebb3-fdba-4047-87ce-5845d04111d2" released by "delete_volume" :: held 1.891s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['04051517-d24b-4869-8f9c-77f6ec4b5444', 'dca189e9-c2f0-4273-acd9-1be83431c41b', '5c1012c2-5751-47c5-bce9-b89d29db43fb', 'aad8d5ae-86f8-4ca0-b14b-d8c51eae5f8e'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:39 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:39 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-2309f75e-9028-435d-a362-8489f0ca94c3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-2309f75e-9028-435d-a362-8489f0ca94c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-2309f75e-9028-435d-a362-8489f0ca94c3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:39 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] cd66455c-9772-4d79-b400-0ea9cf463a75 was qcow2, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-2309f75e-9028-435d-a362-8489f0ca94c3" acquired by "delete_volume" :: waited 0.060s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:39 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:39 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a82da-d416-477b-abeb-b68f07d5e683]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:39 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683" returned: 0 in 0.873s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c62d59-0841-44e8-a5b5-8760be983b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a674f4e9-5462-4787-8fb5-2a5521a2c683', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f5863-8674-4b3a-b8a9-6415ab316c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Volume volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 (a674f4e9-5462-4787-8fb5-2a5521a2c683): created successfully Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f5863-8674-4b3a-b8a9-6415ab316c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (c6a3aec6-563c-46b4-8783-e41cde5534c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f7bdce02-050c-42c2-a006-1e41262d9f8f tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:15:39 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 Jul 09 17:15:39 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:40 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.000s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-915ea3ea-1874-48f5-81d7-a918a99d29ec tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-22d1ebb3-fdba-4047-87ce-5845d04111d2-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:40 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3" returned: 0 in 0.938s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:40 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3 Jul 09 17:15:40 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-a674f4e9-5462-4787-8fb5-2a5521a2c683-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "cinder-a674f4e9-5462-4787-8fb5-2a5521a2c683-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-quobyte-a674f4e9-5462-4787-8fb5-2a5521a2c683" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-a674f4e9-5462-4787-8fb5-2a5521a2c683" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aead7df-0ad8-4a18-9153-92e546fd69ba]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:41 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 Jul 09 17:15:41 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:41 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2309f75e-9028-435d-a362-8489f0ca94c3" returned: 0 in 0.859s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-2309f75e-9028-435d-a362-8489f0ca94c3" released by "delete_volume" :: held 1.868s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['fd37f9c3-3592-4544-9922-99f51f7c91d8', 'b7b58549-f819-4e04-a8e9-971756c3d812', 'f280edc2-bbc3-4493-a0b1-faee046c6c11', '6981f2d3-0599-4d65-a96c-4ccbaceddb27'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:41 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:41 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-99376d26-5379-42a4-aead-29928ddfdba0-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-99376d26-5379-42a4-aead-29928ddfdba0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:41 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 0 in 2.342s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd66455c-9772-4d79-b400-0ea9cf463a75_na7q8qk0devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:15:41 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Converted 112.00 MB image at 47.80 MB/s Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-99376d26-5379-42a4-aead-29928ddfdba0" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:41 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1G Jul 09 17:15:41 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-99376d26-5379-42a4-aead-29928ddfdba0" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a60a1-ca36-45c9-99cf-2b05fdbc28f4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:42 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 Jul 09 17:15:42 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:42 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683" returned: 0 in 1.290s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:42 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683 Jul 09 17:15:42 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:42 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.801s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3f4bc9ed-31dd-4cac-acac-5ba3b94964c2 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-2309f75e-9028-435d-a362-8489f0ca94c3-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Flow 'volume_create_manager' (7a1597d1-2287-4ed0-8c43-dc62322e9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8866edac-3d55-4e60-95c0-b9b21dfa3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8866edac-3d55-4e60-95c0-b9b21dfa3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27abd6ea-1e45-4a6d-acb3-9a10a80fea40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e449badf2f14ca3886bca5949ccea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:42Z,use_quota=True,user_id='c4f8b9b7160c4a0593aa9391fc368089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b410343-87c2-461e-88d0-3496739829df),volume_type_id=7b410343-87c2-461e-88d0-3496739829df)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c88f2-fbde-4fd5-bb5f-76a45e07c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c88f2-fbde-4fd5-bb5f-76a45e07c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2966bc5c-af55-43d6-ba06-a717222a2d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:15:42 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 1G" returned: 0 in 0.847s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[24419ec1-19bd-4c4e-aa9e-aed3da6cacff]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2966bc5c-af55-43d6-ba06-a717222a2d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27abd6ea-1e45-4a6d-acb3-9a10a80fea40', 'volume_name': 'volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40', 'volume_size': 1, 'image_id': 'ab37f55a-1025-426a-8392-6379c534092a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2ec71f2c926c01b56a25cbb5c2f06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e449badf2f14ca3886bca5949ccea00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eb3881a5b5fadbd87175e750308c86a477d416e8b86d0fcca24720585e6faf32ef4490b38e2954de9b2a00691d93c786b4d7f9a178ab241cf660de7fa3ebde', 'id': 'ab37f55a-1025-426a-8392-6379c534092a', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab37f55a-1025-426a-8392-6379c534092a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda384ca-2719-4094-9776-2ea950a63fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda384ca-2719-4094-9776-2ea950a63fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6fc391-656a-49db-82d7-515138e1e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:42 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40', 'volume_size': 1, 'image_id': 'ab37f55a-1025-426a-8392-6379c534092a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2ec71f2c926c01b56a25cbb5c2f06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e449badf2f14ca3886bca5949ccea00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eb3881a5b5fadbd87175e750308c86a477d416e8b86d0fcca24720585e6faf32ef4490b38e2954de9b2a00691d93c786b4d7f9a178ab241cf660de7fa3ebde', 'id': 'ab37f55a-1025-426a-8392-6379c534092a', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab37f55a-1025-426a-8392-6379c534092a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Trying to clone 27abd6ea-1e45-4a6d-acb3-9a10a80fea40 from image ab37f55a-1025-426a-8392-6379c534092a at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:15:42 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:42 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:15:42 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Image download 0.00 MB at 0.00 MB/s Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2ae8d-4051-474a-b840-6c64812991c6]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:42 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0" returned: 0 in 1.108s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:42 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0 Jul 09 17:15:42 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:43 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a674f4e9-5462-4787-8fb5-2a5521a2c683" returned: 0 in 0.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:43 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:43 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-a674f4e9-5462-4787-8fb5-2a5521a2c683" released by "delete_volume" :: held 2.203s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Created reservations ['ed9e12ea-f534-4b5d-9708-e62ef4ad7713', 'c5178076-e76f-4325-85c1-edef47ab0b20', 'e21fb4a7-99b5-47af-8f50-01687ce50e74', 'd4c1cdcf-44b0-4238-aea4-7393750eb59f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:43 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:43 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:43 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 0 in 1.096s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:43 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-99376d26-5379-42a4-aead-29928ddfdba0" returned: 0 in 0.864s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-99376d26-5379-42a4-aead-29928ddfdba0" released by "delete_volume" :: held 2.057s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:43 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:43 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:43 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['493186e4-7602-498b-b7f5-b0f8574df973', '50977441-2327-48e2-a8ab-46bd9d3924b1', '1c589e17-6db9-425e-81a7-3b5d9db56528', '091723c1-1fa9-4c73-a0ca-c484bb8a1573'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:44 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:44 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:44 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:44 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-a76e67ad-c582-4d22-a5fc-f11e345b8aba-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-a76e67ad-c582-4d22-a5fc-f11e345b8aba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-a76e67ad-c582-4d22-a5fc-f11e345b8aba" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:44 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-a76e67ad-c582-4d22-a5fc-f11e345b8aba" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.957s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Deleted volume successfully. Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b7be1-6fce-4501-9421-4e8fb0563585]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-199a1316-fc42-427e-afac-13c2bba611aa tempest-VolumesActionsTest-2042775929 None] Lock "cinder-a674f4e9-5462-4787-8fb5-2a5521a2c683-delete_volume" released by "delete_volume" :: held 3.567s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:44 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba Jul 09 17:15:44 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:44 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 1 in 1.131s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Downloaded image cd66455c-9772-4d79-b400-0ea9cf463a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}])) to volume aacbdead-eb9b-44fc-b007-52161576f486 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Temporary image cd66455c-9772-4d79-b400-0ea9cf463a75 for user 582058698e0c4c9c857de1948805811a is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Marking volume aacbdead-eb9b-44fc-b007-52161576f486 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Copying metadata from image cd66455c-9772-4d79-b400-0ea9cf463a75 to aacbdead-eb9b-44fc-b007-52161576f486. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Creating volume glance metadata for volume aacbdead-eb9b-44fc-b007-52161576f486 backed by image cd66455c-9772-4d79-b400-0ea9cf463a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:15:44 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 1 in 1.084s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:44 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Temporary image ab37f55a-1025-426a-8392-6379c534092a is fetched for user c4f8b9b7160c4a0593aa9391fc368089. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215948d8-a515-44aa-aa41-ea8852c8354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aacbdead-eb9b-44fc-b007-52161576f486', 'volume_size': 1, 'image_id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd66455c-9772-4d79-b400-0ea9cf463a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d5c26756461440d9704917584f2daff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd66455c-9772-4d79-b400-0ea9cf463a75', 'created_at': datetime.datetime(2026, 7, 9, 14, 54, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd66455c-9772-4d79-b400-0ea9cf463a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8056aeb0-4857-48c0-b040-55836a12f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa9605-dd24-4c61-b0fc-08ea315087f4]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Volume volume-aacbdead-eb9b-44fc-b007-52161576f486 (aacbdead-eb9b-44fc-b007-52161576f486): created successfully Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8056aeb0-4857-48c0-b040-55836a12f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (d31c4336-866c-487c-ba1e-4c730d7a633b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:45 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.150s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-06a775f3-c002-46fe-9490-233b55602b53 tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (5a998376-2298-422d-ae94-11f2a6c2cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c29097-7abb-48fa-879d-4b16e5a0525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c29097-7abb-48fa-879d-4b16e5a0525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2080802003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8936a-06f7-4d91-a968-652df48f3662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:45Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1dfa23-6bae-43a3-afeb-d2d8ddd2e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:45 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1dfa23-6bae-43a3-afeb-d2d8ddd2e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6863ccc1-51b0-4a25-9b7e-f47c018f7d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6863ccc1-51b0-4a25-9b7e-f47c018f7d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a8936a-06f7-4d91-a968-652df48f3662', 'volume_name': 'volume-a6a8936a-06f7-4d91-a968-652df48f3662', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37951d6-a960-4bdd-b307-650acf9c45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37951d6-a960-4bdd-b307-650acf9c45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f485e4b4-5282-4dd4-ae7c-f177e1ba43a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Volume a6a8936a-06f7-4d91-a968-652df48f3662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a8936a-06f7-4d91-a968-652df48f3662', 'volume_size': 1} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2080802003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8936a-06f7-4d91-a968-652df48f3662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:45Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Creating volume a6a8936a-06f7-4d91-a968-652df48f3662 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:45 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba" returned: 0 in 1.009s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:45 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 1073741824 Jul 09 17:15:45 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8fdaa84b-5b6e-4fe6-9bdc-5435e4409515 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-99376d26-5379-42a4-aead-29928ddfdba0-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:45 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba Jul 09 17:15:45 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:45 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:46 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:46 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:46 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a76e67ad-c582-4d22-a5fc-f11e345b8aba" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-a76e67ad-c582-4d22-a5fc-f11e345b8aba" released by "delete_volume" :: held 1.818s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['d103d5e2-49f7-42cb-ac7b-147b1bff7695', '72e8cfa5-cef7-446c-9209-3950d1664aa4', '576e4184-ecab-4491-a208-951d93f0b0d8', 'c325b907-badc-492f-95cd-41d0cf7fde53'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:46 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:46 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:46 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 1073741824" returned: 0 in 0.999s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:46 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 Jul 09 17:15:46 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-a53a44fb-b56e-46ad-9f0c-58cb282ddfff-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-a53a44fb-b56e-46ad-9f0c-58cb282ddfff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "cinder-quobyte-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda9c12c-2a34-462e-8b27-ff17f57d749d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:46 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 1 in 0.897s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:46 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff Jul 09 17:15:46 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:47 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662" returned: 0 in 0.844s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:47 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27abd6ea-1e45-4a6d-acb3-9a10a80fea40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e449badf2f14ca3886bca5949ccea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:42Z,use_quota=True,user_id='c4f8b9b7160c4a0593aa9391fc368089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b410343-87c2-461e-88d0-3496739829df),volume_type_id=7b410343-87c2-461e-88d0-3496739829df)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Creating volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:47 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.030s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:47 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1073741824 Jul 09 17:15:47 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f485e4b4-5282-4dd4-ae7c-f177e1ba43a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a8936a-06f7-4d91-a968-652df48f3662', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1073f3da-cf91-4236-8d08-6bd40bd96f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Volume volume-a6a8936a-06f7-4d91-a968-652df48f3662 (a6a8936a-06f7-4d91-a968-652df48f3662): created successfully Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1073f3da-cf91-4236-8d08-6bd40bd96f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (5a998376-2298-422d-ae94-11f2a6c2cde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (b865d9db-a67d-4229-b726-56d442b7bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ee1c0-1e93-4ba6-866a-609ffe1dd605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ee1c0-1e93-4ba6-866a-609ffe1dd605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980130157',display_name='tempest-VolumesGetTest-Volume-1326044998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104d7d30-8c49-47a5-8832-284794e5a5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:47Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac456c-285c-4a2b-b562-acc9bf6ab501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac456c-285c-4a2b-b562-acc9bf6ab501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35472fde-0414-4f8e-988a-a7afb551419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35472fde-0414-4f8e-988a-a7afb551419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104d7d30-8c49-47a5-8832-284794e5a5d8', 'volume_name': 'volume-104d7d30-8c49-47a5-8832-284794e5a5d8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e10c2ae-5ba1-46ab-af1e-5de95ad7eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e10c2ae-5ba1-46ab-af1e-5de95ad7eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a48539-3bce-400d-8ddd-659e27b87ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Volume 104d7d30-8c49-47a5-8832-284794e5a5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104d7d30-8c49-47a5-8832-284794e5a5d8', 'volume_size': 1} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a0e00919-0bb9-42e8-8143-61d214a2a4a7 tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-a76e67ad-c582-4d22-a5fc-f11e345b8aba-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7e7ac0d0-88a8-41ea-a374-b490b26ccc08 tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:15:47 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" returned: 0 in 1.025s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:47 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff Jul 09 17:15:47 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:48 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1073741824" returned: 0 in 0.900s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:48 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:48 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:48 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" returned: 0 in 0.684s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-quobyte-a53a44fb-b56e-46ad-9f0c-58cb282ddfff" released by "delete_volume" :: held 1.776s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-a6a8936a-06f7-4d91-a968-652df48f3662-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "cinder-a6a8936a-06f7-4d91-a968-652df48f3662-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Created reservations ['e01ae637-e1f8-471d-83d4-e3ca0d52e00e', 'a750d070-5dbd-4340-8b24-5abadf0b37ca', '228810f5-ad7a-4f08-946d-dd6adb91150f', 'c5f1496c-b8c6-4568-a32c-45d030f10f79'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-quobyte-a6a8936a-06f7-4d91-a968-652df48f3662" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-a6a8936a-06f7-4d91-a968-652df48f3662" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f5fcc1-0ce7-47aa-a8dc-e3ee93032006]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:48 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:48 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:48 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 Jul 09 17:15:48 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:48 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 0 in 0.782s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980130157',display_name='tempest-VolumesGetTest-Volume-1326044998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104d7d30-8c49-47a5-8832-284794e5a5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea09b6ecd31475e823e6a593508551b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:47Z,use_quota=True,user_id='582058698e0c4c9c857de1948805811a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Creating volume 104d7d30-8c49-47a5-8832-284794e5a5d8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:48 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:49 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 1073741824 Jul 09 17:15:49 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Attempting download of ab37f55a-1025-426a-8392-6379c534092a ((None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}])) to volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1284472a-5b6f-40ff-ae0c-09f1c1b8c0a2]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:49 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h Jul 09 17:15:49 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:49 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.879s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:49 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Deleted volume successfully. Jul 09 17:15:49 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-88cb1e07-be14-48ab-83dc-e546ee2d5baf tempest-CreateVolumesFromSourceVolumeTest-1113970326 None] Lock "cinder-a53a44fb-b56e-46ad-9f0c-58cb282ddfff-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662" returned: 0 in 0.995s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:49 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662 Jul 09 17:15:49 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:50 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 1073741824" returned: 0 in 1.037s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:50 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 Jul 09 17:15:50 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:50 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h" returned: 0 in 1.067s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:50 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h Jul 09 17:15:50 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:50 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a6a8936a-06f7-4d91-a968-652df48f3662" returned: 0 in 0.965s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-a6a8936a-06f7-4d91-a968-652df48f3662" released by "delete_volume" :: held 2.026s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Created reservations ['05614da0-7d2a-419b-b527-21bf615c2756', 'b0f6443d-cc15-4147-8d3d-e01b35c2b171', '294dfe6a-a097-4b43-b2eb-2c42f8832138', 'cd9ae808-6984-48c8-8fb4-1b8726e66c8a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:50 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:50 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:50 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8" returned: 0 in 0.836s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a48539-3bce-400d-8ddd-659e27b87ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104d7d30-8c49-47a5-8832-284794e5a5d8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57d1190-d0dc-45f4-b8f5-8bd0aafc258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Volume volume-104d7d30-8c49-47a5-8832-284794e5a5d8 (104d7d30-8c49-47a5-8832-284794e5a5d8): created successfully Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57d1190-d0dc-45f4-b8f5-8bd0aafc258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Flow 'volume_create_manager' (b865d9db-a67d-4229-b726-56d442b7bc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-76667e99-0ef6-45e9-90cf-e844a5c623f7 tempest-VolumesGetTest-176683340 None] Created volume successfully. Jul 09 17:15:51 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h" returned: 1 in 0.946s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab37f55a-1025-426a-8392-6379c534092a_u5dhjn2h' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e4d9f5-1847-4f2b-b0af-706a3d803094]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:51 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:51 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:51 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.711s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Deleted volume successfully. Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-546cf76a-0165-4392-a075-ab92d697543b tempest-VolumesActionsTest-2042775929 None] Lock "cinder-a6a8936a-06f7-4d91-a968-652df48f3662-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-104d7d30-8c49-47a5-8832-284794e5a5d8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "cinder-104d7d30-8c49-47a5-8832-284794e5a5d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-104d7d30-8c49-47a5-8832-284794e5a5d8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-104d7d30-8c49-47a5-8832-284794e5a5d8" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:51 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff4f40-7ddb-46dc-9d15-0ea1f1b7330d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:52 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD Jul 09 17:15:52 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:52 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 Jul 09 17:15:52 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (b282d72c-b3d5-4abc-af76-472ff19a94a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05226169-8175-4f59-9e26-6c68c28ad502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05226169-8175-4f59-9e26-6c68c28ad502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437706639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223dc5a8-bfb4-4cd3-868b-102f5fadef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:52Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e4e30c-e1bf-4ef5-9a2e-f188b267d188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e4e30c-e1bf-4ef5-9a2e-f188b267d188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca43180-6511-41cc-b529-ccfa9b8a1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca43180-6511-41cc-b529-ccfa9b8a1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223dc5a8-bfb4-4cd3-868b-102f5fadef0f', 'volume_name': 'volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f151ac-9933-4d46-bb7b-d5927f614cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f151ac-9933-4d46-bb7b-d5927f614cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5912dd18-f442-4885-9d78-44a087c41623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:52 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Volume 223dc5a8-bfb4-4cd3-868b-102f5fadef0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f', 'volume_size': 1} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437706639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223dc5a8-bfb4-4cd3-868b-102f5fadef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:52Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Creating volume 223dc5a8-bfb4-4cd3-868b-102f5fadef0f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:52 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:52 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f 1073741824 Jul 09 17:15:52 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:52 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD" returned: 1 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] ab37f55a-1025-426a-8392-6379c534092a was raw, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:52 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:52 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:52 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8" returned: 0 in 0.995s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:53 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8 Jul 09 17:15:53 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:53 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f 1073741824" returned: 0 in 1.071s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:53 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 0 in 0.914s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab37f55a-1025-426a-8392-6379c534092a_ti5xcz_xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:15:53 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:53 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f Jul 09 17:15:53 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:53 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1G Jul 09 17:15:53 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:53 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-104d7d30-8c49-47a5-8832-284794e5a5d8" returned: 0 in 0.826s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-104d7d30-8c49-47a5-8832-284794e5a5d8" released by "delete_volume" :: held 1.894s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Created reservations ['a16c5bed-04e8-49a4-9510-e691b5e15847', '9e6623af-ceb2-4e6f-904a-c1a3a739d477', 'c724af2a-5a55-4669-ae2b-b3da3809d8c7', '7a751afb-67ef-4fde-982f-e2a7af1c3349'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:54 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:54 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-aacbdead-eb9b-44fc-b007-52161576f486-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "cinder-aacbdead-eb9b-44fc-b007-52161576f486-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Acquiring lock "cinder-quobyte-aacbdead-eb9b-44fc-b007-52161576f486" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-aacbdead-eb9b-44fc-b007-52161576f486" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a6731-aeb8-4fc9-a9fb-707af6918f34]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:54 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" returned: 0 in 0.923s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5912dd18-f442-4885-9d78-44a087c41623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34397287-7f9b-4ed1-9005-f8048d04f53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:54 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Volume volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f (223dc5a8-bfb4-4cd3-868b-102f5fadef0f): created successfully Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34397287-7f9b-4ed1-9005-f8048d04f53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (b282d72c-b3d5-4abc-af76-472ff19a94a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f9a4601c-2e10-4d3a-bce9-60528763eff4 tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:15:54 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:54 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:54 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 1G" returned: 0 in 1.061s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eabd82f-2099-487d-8224-7e779a4d18e2]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:54 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.867s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:15:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3fd13925-d5f3-4500-b538-eeeb521ca6e6 tempest-VolumesGetTest-176683340 None] Lock "cinder-104d7d30-8c49-47a5-8832-284794e5a5d8-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:54 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:54 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Flow 'volume_create_manager' (41716766-cb92-4ce0-9099-ea71d37ec8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa8d43b-b16a-4032-bdde-bc34cd473d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa8d43b-b16a-4032-bdde-bc34cd473d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75ee59-914d-4d77-aa81-ccc8ec51a220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c889be0d1348f093de90c2cfd49425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:55Z,use_quota=True,user_id='f978882078f5490ea4b4fb25b4e9ec34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d48987c-59ef-41ef-844c-411e0740aa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d48987c-59ef-41ef-844c-411e0740aa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19cbabf-17b3-407e-b471-f3d692c3eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:15:55 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 0 in 0.930s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:55 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:55 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:55 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 0 in 0.916s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19cbabf-17b3-407e-b471-f3d692c3eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d75ee59-914d-4d77-aa81-ccc8ec51a220', 'volume_name': 'volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220', 'volume_size': 1, 'image_id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'becdb892eb888f94db4c57ef5854969e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64c889be0d1348f093de90c2cfd49425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17ac73bcae450701d0b23a34b61549fd1353fb53565b90d59a513562e76b80a643ddb1222f4490414d21c54a49f914073edb716ea0ab1eb7b7dafc7c5c1ffd62', 'id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8f448d6-086e-42b3-a92e-d87168fd78f0/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c7d37d-c3d2-4a5a-8768-deceb0e1466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c7d37d-c3d2-4a5a-8768-deceb0e1466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba4696-0845-4a26-83ad-a26c966782f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220', 'volume_size': 1, 'image_id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'becdb892eb888f94db4c57ef5854969e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64c889be0d1348f093de90c2cfd49425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17ac73bcae450701d0b23a34b61549fd1353fb53565b90d59a513562e76b80a643ddb1222f4490414d21c54a49f914073edb716ea0ab1eb7b7dafc7c5c1ffd62', 'id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8f448d6-086e-42b3-a92e-d87168fd78f0/file', 'properties': {}}, 'image_service': } Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Trying to clone 2d75ee59-914d-4d77-aa81-ccc8ec51a220 from image a8f448d6-086e-42b3-a92e-d87168fd78f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:15:55 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:55 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-223dc5a8-bfb4-4cd3-868b-102f5fadef0f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:15:55 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Image download 0.00 MB at 0.00 MB/s Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "cinder-223dc5a8-bfb4-4cd3-868b-102f5fadef0f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-quobyte-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471e960-58d5-41a9-8bac-6da49ef5978d]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc0b27c-2099-4324-8f27-b18aa5f8de43]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:56 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:15:56 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:56 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f Jul 09 17:15:56 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:56 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 1 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:56 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486 Jul 09 17:15:56 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:56 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 1 in 0.886s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Downloaded image ab37f55a-1025-426a-8392-6379c534092a ((None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}])) to volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Temporary image ab37f55a-1025-426a-8392-6379c534092a for user c4f8b9b7160c4a0593aa9391fc368089 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Marking volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Copying metadata from image ab37f55a-1025-426a-8392-6379c534092a to 27abd6ea-1e45-4a6d-acb3-9a10a80fea40. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Creating volume glance metadata for volume 27abd6ea-1e45-4a6d-acb3-9a10a80fea40 backed by image ab37f55a-1025-426a-8392-6379c534092a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ab37f55a-1025-426a-8392-6379c534092a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f2ec71f2c926c01b56a25cbb5c2f06a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6fc391-656a-49db-82d7-515138e1e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40', 'volume_size': 1, 'image_id': 'ab37f55a-1025-426a-8392-6379c534092a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab37f55a-1025-426a-8392-6379c534092a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2ec71f2c926c01b56a25cbb5c2f06a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e449badf2f14ca3886bca5949ccea00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9eb3881a5b5fadbd87175e750308c86a477d416e8b86d0fcca24720585e6faf32ef4490b38e2954de9b2a00691d93c786b4d7f9a178ab241cf660de7fa3ebde', 'id': 'ab37f55a-1025-426a-8392-6379c534092a', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab37f55a-1025-426a-8392-6379c534092a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec416b2-53b1-4773-a01c-f90e0b179e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Volume volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 (27abd6ea-1e45-4a6d-acb3-9a10a80fea40): created successfully Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec416b2-53b1-4773-a01c-f90e0b179e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Flow 'volume_create_manager' (7a1597d1-2287-4ed0-8c43-dc62322e9da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e257b93d-fc8c-402d-9e1e-45cbeba87f5c tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Created volume successfully. Jul 09 17:15:56 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:56 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" returned: 0 in 0.848s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:56 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f Jul 09 17:15:56 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:56 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:15:56 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:57 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aacbdead-eb9b-44fc-b007-52161576f486" returned: 0 in 0.779s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "cinder-quobyte-aacbdead-eb9b-44fc-b007-52161576f486" released by "delete_volume" :: held 2.709s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Created reservations ['255b74a2-618d-4a7b-9be0-59f4e681532d', '1d98f7fa-ce92-4723-82b9-d398d30f57d6', '1e6cd9f4-fa1e-45d0-93be-49635b752046', 'd7623a0c-b7ad-4a93-bcc3-2172141d3183'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:57 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:57 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Acquiring lock "cinder-27abd6ea-1e45-4a6d-acb3-9a10a80fea40-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "cinder-27abd6ea-1e45-4a6d-acb3-9a10a80fea40-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:57 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" returned: 0 in 0.740s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-223dc5a8-bfb4-4cd3-868b-102f5fadef0f" released by "delete_volume" :: held 1.653s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Acquiring lock "cinder-quobyte-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "cinder-quobyte-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e03a2-52aa-4600-b683-2a718c52ebe0]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:57 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Temporary image a8f448d6-086e-42b3-a92e-d87168fd78f0 is fetched for user f978882078f5490ea4b4fb25b4e9ec34. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Created reservations ['7780885f-6339-49fb-ba90-dd7425b87f4c', '2b2db03a-c855-4384-a071-c8d849011028', 'd3819c5b-d0d1-4df6-944b-12dce34d6876', 'cf883cc8-2efd-44b9-89d1-39aad3e75a39'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:57 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:57 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a4359-6b3b-434c-a9b8-8d78d1492b87]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:15:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:57 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:15:57 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:58 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:15:58 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:58 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.141s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:58 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Deleted volume successfully. Jul 09 17:15:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0175e63f-0a53-4817-8796-c451f6ae2f8b tempest-VolumesGetTest-176683340 None] Lock "cinder-aacbdead-eb9b-44fc-b007-52161576f486-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:58 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:59 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 0 in 1.283s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:59 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:15:59 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:15:59 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (9a9c7861-03d8-4646-a922-5179c379942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:15:59 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:15:59 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142c2307-ed84-47c0-a30a-ade19384e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.290s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:15:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Deleted volume successfully. Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142c2307-ed84-47c0-a30a-ade19384e912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-373866890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54215c83-c00e-49a1-b0dc-c4eb0880f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:59Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3284275-087d-478e-8f93-aafc136fef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3284275-087d-478e-8f93-aafc136fef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21372203-a0fa-4b1a-864f-4ac3d6c772f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21372203-a0fa-4b1a-864f-4ac3d6c772f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54215c83-c00e-49a1-b0dc-c4eb0880f5e0', 'volume_name': 'volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629d852a-ae57-4545-a515-ad04d2f86322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629d852a-ae57-4545-a515-ad04d2f86322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11876a64-a70d-4408-98c4-b80c5b90e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:15:59 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Volume 54215c83-c00e-49a1-b0dc-c4eb0880f5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0', 'volume_size': 1} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-373866890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54215c83-c00e-49a1-b0dc-c4eb0880f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:59Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Creating volume 54215c83-c00e-49a1-b0dc-c4eb0880f5e0 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:15:59 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:15:59 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 1073741824 Jul 09 17:15:59 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ddc17b78-b8e0-46e5-984f-64ea3b0f57b3 tempest-VolumesActionsTest-2042775929 None] Lock "cinder-223dc5a8-bfb4-4cd3-868b-102f5fadef0f-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:15:59 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 1 in 1.030s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:15:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:00 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 1 in 1.017s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:00 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40 Jul 09 17:16:00 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:00 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 1073741824" returned: 0 in 1.016s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:00 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 Jul 09 17:16:00 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:00 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:00 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:00 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" returned: 0 in 0.777s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "cinder-quobyte-27abd6ea-1e45-4a6d-acb3-9a10a80fea40" released by "delete_volume" :: held 3.163s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:00 devstack cinder-volume[86876]: WARNING cinder.quota [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:16:00 devstack cinder-volume[86876]: WARNING cinder.quota [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 17:16:00 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Created reservations ['abd8c02f-bcf2-4c59-979c-c4fb0fbe6cc1', '7e141543-eb15-409c-82e2-57e85efd99cc', '9e810510-c536-4447-829d-6b53e28c889f', 'c84b12e0-e73d-4ee4-ac70-ac80ad7f3730'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:01 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:01 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:01 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75ee59-914d-4d77-aa81-ccc8ec51a220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c889be0d1348f093de90c2cfd49425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:15:55Z,use_quota=True,user_id='f978882078f5490ea4b4fb25b4e9ec34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Creating volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:01 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11876a64-a70d-4408-98c4-b80c5b90e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b60de11-6043-41d2-815c-d8a1b000f0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:01 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Volume volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 (54215c83-c00e-49a1-b0dc-c4eb0880f5e0): created successfully Jul 09 17:16:01 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1073741824 Jul 09 17:16:01 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b60de11-6043-41d2-815c-d8a1b000f0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (9a9c7861-03d8-4646-a922-5179c379942e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-37ec3f7c-1a91-498a-80e6-711744ec08d6 tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:16:01 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 28 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:16:01 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.843s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Deleted volume successfully. Jul 09 17:16:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-bce66182-134a-43df-8d61-27342407d8fa tempest-VolumeAndVolumeTypeFromImageTest-121338100 None] Lock "cinder-27abd6ea-1e45-4a6d-acb3-9a10a80fea40-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:02 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1073741824" returned: 0 in 1.046s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:02 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:02 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-54215c83-c00e-49a1-b0dc-c4eb0880f5e0-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "cinder-54215c83-c00e-49a1-b0dc-c4eb0880f5e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Acquiring lock "cinder-quobyte-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6e114-9555-4793-8ffb-bdb885d9c304]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:02 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 Jul 09 17:16:02 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:03 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 0 in 0.943s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Attempting download of a8f448d6-086e-42b3-a92e-d87168fd78f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}])) to volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7aeb3-95c3-48ca-86ea-3d0762da2488]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:03 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i Jul 09 17:16:03 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:03 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" returned: 0 in 0.975s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:03 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0 Jul 09 17:16:03 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:04 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i" returned: 0 in 0.853s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:04 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i Jul 09 17:16:04 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:04 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" returned: 0 in 0.875s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "cinder-quobyte-54215c83-c00e-49a1-b0dc-c4eb0880f5e0" released by "delete_volume" :: held 1.914s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Created reservations ['0a279222-e049-4f36-88c7-e3dbf5cb59ba', '0462c94b-6181-4c89-8245-94424fc0f6e8', 'c8f97480-70e3-4d18-8015-c0662a1b79b9', '3c315a2f-ddfa-483f-8317-79021bb55462'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:04 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:04 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:04 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i" returned: 1 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8f448d6-086e-42b3-a92e-d87168fd78f0_70m3oz8i' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[53596681-8b8a-44d5-80ac-2e31722fd7c0]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:05 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:16:05 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (a2485b46-fc40-450b-9598-b0f8a416851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ecd9de-0fd9-4ce4-bb17-f080ace11e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ecd9de-0fd9-4ce4-bb17-f080ace11e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766455575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87b0edf-9f18-4526-8a07-0e7bde5e6a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:05Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037d61d1-48ae-4a88-8b9b-5fc6a07281ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037d61d1-48ae-4a88-8b9b-5fc6a07281ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41686c62-600f-44d7-b462-381cc6d90016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41686c62-600f-44d7-b462-381cc6d90016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87b0edf-9f18-4526-8a07-0e7bde5e6a28', 'volume_name': 'volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd20063f-e6b5-49d4-837c-47a3aef98847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd20063f-e6b5-49d4-837c-47a3aef98847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d864b52-d1ad-4422-8904-d79252f967bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:05 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Volume f87b0edf-9f18-4526-8a07-0e7bde5e6a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28', 'volume_size': 1} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766455575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87b0edf-9f18-4526-8a07-0e7bde5e6a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1ab83d3b60496488afc9ff6ea62469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:05Z,use_quota=True,user_id='a6898a225b1e4e9d9580b9ef58bcf9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Creating volume f87b0edf-9f18-4526-8a07-0e7bde5e6a28 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:05 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:05 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 1073741824 Jul 09 17:16:05 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:05 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.171s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Deleted volume successfully. Jul 09 17:16:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-680be5dc-6321-47e5-820e-66eba3c2666d tempest-VolumesActionsTest-2042775929 None] Lock "cinder-54215c83-c00e-49a1-b0dc-c4eb0880f5e0-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:06 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 0 in 1.246s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:06 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD Jul 09 17:16:06 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:06 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 1073741824" returned: 0 in 1.042s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:06 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 Jul 09 17:16:06 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:07 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] a8f448d6-086e-42b3-a92e-d87168fd78f0 was raw, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:07 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:07 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:07 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" returned: 0 in 0.965s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d864b52-d1ad-4422-8904-d79252f967bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66217ad-c620-4c62-b4e6-ab9a8543073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:07 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Volume volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 (f87b0edf-9f18-4526-8a07-0e7bde5e6a28): created successfully Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66217ad-c620-4c62-b4e6-ab9a8543073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Flow 'volume_create_manager' (a2485b46-fc40-450b-9598-b0f8a416851e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:07 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f565b381-7e73-49fe-8247-ca66ad7edb1e tempest-VolumesActionsTest-1077975118 None] Created volume successfully. Jul 09 17:16:08 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 0 in 1.096s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a8f448d6-086e-42b3-a92e-d87168fd78f0_te6hscendevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:16:08 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:08 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1G Jul 09 17:16:08 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (3cf4b971-1130-410d-9f5e-1f3e9c0fa5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb575d6-96fb-4149-9525-24d155361ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb575d6-96fb-4149-9525-24d155361ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545750603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:09Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e5251-1f19-4c15-bf85-1cbc80f641be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e5251-1f19-4c15-bf85-1cbc80f641be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85a8398-1475-45a2-b014-289efb767a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85a8398-1475-45a2-b014-289efb767a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8', 'volume_name': 'volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77810daa-9017-437e-afa3-4c30c8190960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77810daa-9017-437e-afa3-4c30c8190960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf19dd9-24d7-4630-b5c0-9fce5be22e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Volume bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8', 'volume_size': 1} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545750603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:09Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Creating volume bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:09 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:09 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 1073741824 Jul 09 17:16:09 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:09 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 1G" returned: 0 in 1.038s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0cedb-628f-48a1-93e9-353d3b036186]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (ff31e78b-7be9-47e9-a0bc-680d4a0d1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:09 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:09 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82c6630-c584-4687-b76e-9e9ce426b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82c6630-c584-4687-b76e-9e9ce426b27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474951332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20d7157-ad36-48ec-a333-0e5088427c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:09Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00dde20-1931-4ea1-bd8b-dadc6539d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00dde20-1931-4ea1-bd8b-dadc6539d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f3fee8-da10-4467-b7ec-796bb7a12d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f3fee8-da10-4467-b7ec-796bb7a12d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20d7157-ad36-48ec-a333-0e5088427c53', 'volume_name': 'volume-a20d7157-ad36-48ec-a333-0e5088427c53', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26596d9a-5738-4e03-a0ec-658510ab5272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26596d9a-5738-4e03-a0ec-658510ab5272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d942e3ac-31ea-4775-91a9-6f9f50c53ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Volume a20d7157-ad36-48ec-a333-0e5088427c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20d7157-ad36-48ec-a333-0e5088427c53', 'volume_size': 1} Jul 09 17:16:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-f87b0edf-9f18-4526-8a07-0e7bde5e6a28-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-f87b0edf-9f18-4526-8a07-0e7bde5e6a28-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "cinder-quobyte-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-quobyte-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" acquired by "delete_volume" :: waited 0.058s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (55ae748f-19b3-49b1-86b7-6cd0bd7d00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b186-4e5f-4c3f-892b-dbe421079001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98043e0-bed6-4f4a-a878-3bab2fec7430]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b186-4e5f-4c3f-892b-dbe421079001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466466355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af83662-d7ca-41cb-a527-b8db88acd947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:10Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd33323-1094-47af-9690-a53bf0ab9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd33323-1094-47af-9690-a53bf0ab9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efc44a-7f47-4647-9f49-784ef605bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efc44a-7f47-4647-9f49-784ef605bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af83662-d7ca-41cb-a527-b8db88acd947', 'volume_name': 'volume-2af83662-d7ca-41cb-a527-b8db88acd947', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591353b0-c177-49bd-ab16-8868279e7f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591353b0-c177-49bd-ab16-8868279e7f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb2e18b-92e1-42fb-9574-f95791d3b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Volume 2af83662-d7ca-41cb-a527-b8db88acd947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af83662-d7ca-41cb-a527-b8db88acd947', 'volume_size': 1} Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:10 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 Jul 09 17:16:10 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:10 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 1073741824" returned: 0 in 1.834s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:11 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 Jul 09 17:16:11 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:11 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (38bf78f6-ec38-430f-8995-50e2039c5aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaa6041-9bfd-42e7-b011-bdd4869dc763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 0 in 1.857s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaa6041-9bfd-42e7-b011-bdd4869dc763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808099255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fb24be-53e1-4658-8182-f1dcea4e851f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:11Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fab46bb-f55d-4662-a9e9-bb800f460446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fab46bb-f55d-4662-a9e9-bb800f460446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1d8abf-1896-4dbc-9925-453a3d0eabab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1d8abf-1896-4dbc-9925-453a3d0eabab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fb24be-53e1-4658-8182-f1dcea4e851f', 'volume_name': 'volume-b3fb24be-53e1-4658-8182-f1dcea4e851f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2259f2ef-a773-48d0-8c7a-0d3f13065e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2259f2ef-a773-48d0-8c7a-0d3f13065e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47cb4d9-2c71-4c4c-9ebc-dc94fc8cb011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Volume b3fb24be-53e1-4658-8182-f1dcea4e851f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fb24be-53e1-4658-8182-f1dcea4e851f', 'volume_size': 1} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:11 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:11 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:11 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (3ccefd25-9814-45b4-9c44-2f938bf8018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eb08db-46fd-4172-bab1-d7c3b64ae485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" returned: 0 in 1.394s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eb08db-46fd-4172-bab1-d7c3b64ae485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993668135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f952a-913c-4333-ab4f-9aa930fe5a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:12Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d370f8-e2b1-4fd6-ac71-84f807fe7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d370f8-e2b1-4fd6-ac71-84f807fe7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28 Jul 09 17:16:11 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb516bea-cd9d-4848-ba85-df5120607d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb516bea-cd9d-4848-ba85-df5120607d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2f952a-913c-4333-ab4f-9aa930fe5a6d', 'volume_name': 'volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c76337f-270e-4c49-bb76-b8bc34d76a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c76337f-270e-4c49-bb76-b8bc34d76a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b12a8e7-736a-4ffe-89fa-172b7da88ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Volume 5a2f952a-913c-4333-ab4f-9aa930fe5a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d', 'volume_size': 1} Jul 09 17:16:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:12 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" returned: 0 in 0.986s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] <== create_volume: return (2923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.926s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474951332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20d7157-ad36-48ec-a333-0e5088427c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:09Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Creating volume a20d7157-ad36-48ec-a333-0e5088427c53 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf19dd9-24d7-4630-b5c0-9fce5be22e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:12 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 1073741824 Jul 09 17:16:12 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d69a937-3dec-4c75-898d-71dce44fe3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Volume volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 (bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8): created successfully Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d69a937-3dec-4c75-898d-71dce44fe3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (3cf4b971-1130-410d-9f5e-1f3e9c0fa5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3f3d9074-b6b8-4df9-808f-0cffad106434 tempest-CreateVolumesFromImageTest-1713563063 None] Created volume successfully. Jul 09 17:16:12 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 1 in 1.168s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Downloaded image a8f448d6-086e-42b3-a92e-d87168fd78f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}])) to volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Temporary image a8f448d6-086e-42b3-a92e-d87168fd78f0 for user f978882078f5490ea4b4fb25b4e9ec34 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Marking volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Copying metadata from image a8f448d6-086e-42b3-a92e-d87168fd78f0 to 2d75ee59-914d-4d77-aa81-ccc8ec51a220. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Creating volume glance metadata for volume 2d75ee59-914d-4d77-aa81-ccc8ec51a220 backed by image a8f448d6-086e-42b3-a92e-d87168fd78f0 with: {'image_id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'becdb892eb888f94db4c57ef5854969e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba4696-0845-4a26-83ad-a26c966782f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220', 'volume_size': 1, 'image_id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8f448d6-086e-42b3-a92e-d87168fd78f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'becdb892eb888f94db4c57ef5854969e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64c889be0d1348f093de90c2cfd49425', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17ac73bcae450701d0b23a34b61549fd1353fb53565b90d59a513562e76b80a643ddb1222f4490414d21c54a49f914073edb716ea0ab1eb7b7dafc7c5c1ffd62', 'id': 'a8f448d6-086e-42b3-a92e-d87168fd78f0', 'created_at': datetime.datetime(2026, 7, 9, 15, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 15, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8f448d6-086e-42b3-a92e-d87168fd78f0/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:12 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e222865a-c728-4ce8-8caf-cce57f529b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-quobyte-f87b0edf-9f18-4526-8a07-0e7bde5e6a28" released by "delete_volume" :: held 2.328s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Volume volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 (2d75ee59-914d-4d77-aa81-ccc8ec51a220): created successfully Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e222865a-c728-4ce8-8caf-cce57f529b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Flow 'volume_create_manager' (41716766-cb92-4ce0-9099-ea71d37ec8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b5b05477-dbd0-4be7-a485-05f6b347ddeb tempest-VolumeImageDependencyTests-391671288 None] Created volume successfully. Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Created reservations ['7fee16f7-5aec-4184-92c3-28b3a65ed9ef', '029ba524-3a6a-49bd-b7a2-c9cdb0ea0b46', 'f153ea68-3aa7-4ee2-8b29-b82f60c2b774', 'd8d7ac7b-63ff-4dd1-9ce8-92841294bcca'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:12 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:12 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Acquiring lock "cinder-2d75ee59-914d-4d77-aa81-ccc8ec51a220-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "cinder-2d75ee59-914d-4d77-aa81-ccc8ec51a220-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Acquiring lock "cinder-quobyte-2d75ee59-914d-4d77-aa81-ccc8ec51a220" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "cinder-quobyte-2d75ee59-914d-4d77-aa81-ccc8ec51a220" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a400eeef-0f36-4b60-8644-df66de50799b]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:13 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 1073741824" returned: 0 in 1.280s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:13 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:13 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:13 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 Jul 09 17:16:13 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:13 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.003s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Deleted volume successfully. Jul 09 17:16:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-11a62264-4b21-4601-8a94-2f72aef80597 tempest-VolumesActionsTest-1077975118 None] Lock "cinder-f87b0edf-9f18-4526-8a07-0e7bde5e6a28-delete_volume" released by "delete_volume" :: held 3.703s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:14 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53" returned: 0 in 0.972s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.958s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466466355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af83662-d7ca-41cb-a527-b8db88acd947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:10Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Creating volume 2af83662-d7ca-41cb-a527-b8db88acd947 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:14 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d942e3ac-31ea-4775-91a9-6f9f50c53ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20d7157-ad36-48ec-a333-0e5088427c53', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:14 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 1073741824 Jul 09 17:16:14 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d450bfbc-1769-45b7-a545-53a6168ae538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Volume volume-a20d7157-ad36-48ec-a333-0e5088427c53 (a20d7157-ad36-48ec-a333-0e5088427c53): created successfully Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d450bfbc-1769-45b7-a545-53a6168ae538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (ff31e78b-7be9-47e9-a0bc-680d4a0d1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:14 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 0 in 1.229s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ae3b2f3c-8cbb-4edd-b522-22634c5cc2ea tempest-CreateVolumesFromImageTest-1713563063 None] Created volume successfully. Jul 09 17:16:14 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:14 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:15 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 1073741824" returned: 0 in 1.119s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:15 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 1 in 1.097s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:16:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:15 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 Jul 09 17:16:15 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:15 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220 Jul 09 17:16:15 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:16 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947" returned: 0 in 0.828s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.089s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808099255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fb24be-53e1-4658-8182-f1dcea4e851f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:11Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Creating volume b3fb24be-53e1-4658-8182-f1dcea4e851f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:16 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:16 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2d75ee59-914d-4d77-aa81-ccc8ec51a220" returned: 0 in 0.879s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:16 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f 1073741824 Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb2e18b-92e1-42fb-9574-f95791d3b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af83662-d7ca-41cb-a527-b8db88acd947', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:16 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224709d-df54-4120-8f43-af6cebbdd9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "cinder-quobyte-2d75ee59-914d-4d77-aa81-ccc8ec51a220" released by "delete_volume" :: held 3.317s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Volume volume-2af83662-d7ca-41cb-a527-b8db88acd947 (2af83662-d7ca-41cb-a527-b8db88acd947): created successfully Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224709d-df54-4120-8f43-af6cebbdd9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (55ae748f-19b3-49b1-86b7-6cd0bd7d00ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-133d9a81-b2d5-464c-b7d8-2bfde052749b tempest-CreateVolumesFromImageTest-1713563063 None] Created volume successfully. Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Created reservations ['9f4f9472-023e-49db-b9ae-3ef8f850d7c6', '7d4d09a0-d7ce-4d4b-8574-6b798bce6c19', 'c7e5204c-5119-43e3-865d-e8fd93c9fb2a', '5fdf6cb8-7e52-405b-9b2a-696576728da2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:16 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:16 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:17 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.013s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:17 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Deleted volume successfully. Jul 09 17:16:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5ca04a2b-3750-40f5-bc8f-eaed9e803710 tempest-VolumeImageDependencyTests-391671288 None] Lock "cinder-2d75ee59-914d-4d77-aa81-ccc8ec51a220-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:17 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f 1073741824" returned: 0 in 1.395s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:17 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f Jul 09 17:16:17 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:18 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f" returned: 0 in 0.871s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.936s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993668135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f952a-913c-4333-ab4f-9aa930fe5a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3ad5384e89459089e52bd115817246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:12Z,use_quota=True,user_id='56915ef0556d4fc89fad42d537e165b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Creating volume 5a2f952a-913c-4333-ab4f-9aa930fe5a6d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:18 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:18 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d 1073741824 Jul 09 17:16:18 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47cb4d9-2c71-4c4c-9ebc-dc94fc8cb011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fb24be-53e1-4658-8182-f1dcea4e851f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586637b8-1dbb-4e20-af1f-ae099b016690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Volume volume-b3fb24be-53e1-4658-8182-f1dcea4e851f (b3fb24be-53e1-4658-8182-f1dcea4e851f): created successfully Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586637b8-1dbb-4e20-af1f-ae099b016690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (38bf78f6-ec38-430f-8995-50e2039c5aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fc1b678c-0f9b-417f-950a-33102c3a9650 tempest-CreateVolumesFromImageTest-1713563063 None] Created volume successfully. Jul 09 17:16:19 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d 1073741824" returned: 0 in 1.081s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:19 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d Jul 09 17:16:19 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:20 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" returned: 0 in 0.784s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b12a8e7-736a-4ffe-89fa-172b7da88ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c61c1c-3f76-4ffd-a152-611fd90394e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:20 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Volume volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d (5a2f952a-913c-4333-ab4f-9aa930fe5a6d): created successfully Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c61c1c-3f76-4ffd-a152-611fd90394e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Flow 'volume_create_manager' (3ccefd25-9814-45b4-9c44-2f938bf8018e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a92ae29a-eef1-4731-80d6-2a39724bb29d tempest-CreateVolumesFromImageTest-1713563063 None] Created volume successfully. Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-5a2f952a-913c-4333-ab4f-9aa930fe5a6d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-5a2f952a-913c-4333-ab4f-9aa930fe5a6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-quobyte-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf28a8c-a844-4968-b7c8-b35f061f9d0b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:22 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d Jul 09 17:16:22 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:23 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" returned: 0 in 1.140s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:23 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d Jul 09 17:16:23 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:23 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" returned: 0 in 0.866s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-5a2f952a-913c-4333-ab4f-9aa930fe5a6d" released by "delete_volume" :: held 2.083s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Created reservations ['95b87afa-401a-4c4c-a4b8-7a6d72ddab76', 'd41ff63a-22b0-403d-9234-b471e487bb5f', '60a83175-86ce-4d5c-b81d-2ffac0b99408', 'd667d90c-6689-4fc9-a308-607ed1fc2c1b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:24 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:24 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-b3fb24be-53e1-4658-8182-f1dcea4e851f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:25 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.084s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Deleted volume successfully. Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-b3fb24be-53e1-4658-8182-f1dcea4e851f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0f0d7818-433b-49bb-a001-173f4d18a3e7 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-5a2f952a-913c-4333-ab4f-9aa930fe5a6d-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-quobyte-b3fb24be-53e1-4658-8182-f1dcea4e851f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-b3fb24be-53e1-4658-8182-f1dcea4e851f" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5a99a-4e82-4c27-8bc1-f3aa2bef13be]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (425aafe1-2909-43e4-b48e-a4fdf56d8585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61294fca-48b6-4647-b93d-d8fa23529515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61294fca-48b6-4647-b93d-d8fa23529515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243280537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a44e1e7-1fad-4606-85c0-17a2a44bd9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:25Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3beeb58-c52d-4f28-b551-a85f6614606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3beeb58-c52d-4f28-b551-a85f6614606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976c3db9-b6ba-40d6-9ef8-1e88d7148553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976c3db9-b6ba-40d6-9ef8-1e88d7148553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a44e1e7-1fad-4606-85c0-17a2a44bd9e2', 'volume_name': 'volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29b0dda-b143-4b7b-afd6-b4124e05201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29b0dda-b143-4b7b-afd6-b4124e05201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1921f5c-3dc6-4fd0-80ad-44e3b5b8d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:25 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Volume 3a44e1e7-1fad-4606-85c0-17a2a44bd9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2', 'volume_size': 1} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243280537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a44e1e7-1fad-4606-85c0-17a2a44bd9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:25Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Creating volume 3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:25 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f Jul 09 17:16:25 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:25 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:25 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 1073741824 Jul 09 17:16:25 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:26 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f" returned: 0 in 1.264s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:26 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f Jul 09 17:16:26 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:26 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 1073741824" returned: 0 in 1.133s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:26 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 Jul 09 17:16:26 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:27 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b3fb24be-53e1-4658-8182-f1dcea4e851f" returned: 0 in 0.997s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-b3fb24be-53e1-4658-8182-f1dcea4e851f" released by "delete_volume" :: held 2.327s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Created reservations ['34c3f3d6-a24a-49d3-acf8-5155f614398b', 'aa1e2080-6ec4-4ede-9313-6221ba1590b1', '1c067f2a-3954-4aed-98f9-082c1a6763d3', '4c10b0bf-ca51-4a9e-b743-3c963e2c10fe'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:27 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" returned: 0 in 0.987s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1921f5c-3dc6-4fd0-80ad-44e3b5b8d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee90f5f-d50f-410f-93dd-0ae601ebe1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Volume volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 (3a44e1e7-1fad-4606-85c0-17a2a44bd9e2): created successfully Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee90f5f-d50f-410f-93dd-0ae601ebe1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (425aafe1-2909-43e4-b48e-a4fdf56d8585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-536e982e-39f3-42eb-ae13-aaa53a0cbc9a tempest-ProjectReaderTests-1157103117 None] Created volume successfully. Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:27 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:27 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-2af83662-d7ca-41cb-a527-b8db88acd947-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-2af83662-d7ca-41cb-a527-b8db88acd947-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-quobyte-2af83662-d7ca-41cb-a527-b8db88acd947" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-2af83662-d7ca-41cb-a527-b8db88acd947" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d60f4b2-5784-46ab-b7e0-a25dc31b0481]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:28 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.986s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:28 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Deleted volume successfully. Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dc7f9eb0-dffe-47bd-8a65-9bd2b1a38e75 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-b3fb24be-53e1-4658-8182-f1dcea4e851f-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:29 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 Jul 09 17:16:29 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-quobyte-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c02d5-64ad-48c3-87e1-102624dcb6f4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:29 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 Jul 09 17:16:29 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:29 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947" returned: 0 in 1.114s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:30 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947 Jul 09 17:16:30 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:30 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" returned: 0 in 1.055s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:30 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2 Jul 09 17:16:30 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:30 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2af83662-d7ca-41cb-a527-b8db88acd947" returned: 0 in 0.843s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-2af83662-d7ca-41cb-a527-b8db88acd947" released by "delete_volume" :: held 2.018s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:30 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Created reservations ['02d7e0b8-f2ef-4ecf-847a-43bdcc5dd662', '94e4528f-afeb-4208-ac51-624a1b65996b', '7795b411-a254-455f-bb93-bf6818cb134b', '4895b0a6-4b98-44fa-90dc-f3355526405d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:31 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:31 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (109a0521-1613-414e-98c3-53a4a6e80b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a40be5a-2e50-46a8-8d81-85a32ab0d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:31 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" returned: 0 in 0.823s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2" released by "delete_volume" :: held 1.936s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a40be5a-2e50-46a8-8d81-85a32ab0d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-568043209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f196a1-7537-4d09-9fa0-c9f0d1fa7017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:31Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ffd529-2c81-452d-a0e8-784686f6f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ffd529-2c81-452d-a0e8-784686f6f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31393f98-28db-4c1c-b12d-4e108d691b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31393f98-28db-4c1c-b12d-4e108d691b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f196a1-7537-4d09-9fa0-c9f0d1fa7017', 'volume_name': 'volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1208f51-2377-4243-8dfa-fa75f341f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1208f51-2377-4243-8dfa-fa75f341f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e03f0a-8a23-489d-a377-b52313a2d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Volume 92f196a1-7537-4d09-9fa0-c9f0d1fa7017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017', 'volume_size': 1} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-568043209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f196a1-7537-4d09-9fa0-c9f0d1fa7017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:31Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Creating volume 92f196a1-7537-4d09-9fa0-c9f0d1fa7017 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:31 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:31 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 1073741824 Jul 09 17:16:31 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Created reservations ['71b6d3df-5c39-4b31-a117-8c6c52cc15cb', 'ddcf0910-2098-4187-9098-2628e11ef9cc', '4d5004ee-7640-4c07-8b9c-f15184f4b9c1', '7e186c4e-4574-4a2e-912a-fe6857c8a002'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:31 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:31 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:31 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.841s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:31 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Deleted volume successfully. Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8904c9fe-32f7-4946-8ca8-bb1fdfb2f652 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-2af83662-d7ca-41cb-a527-b8db88acd947-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-a20d7157-ad36-48ec-a333-0e5088427c53-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-a20d7157-ad36-48ec-a333-0e5088427c53-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-quobyte-a20d7157-ad36-48ec-a333-0e5088427c53" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-a20d7157-ad36-48ec-a333-0e5088427c53" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1715f-226c-4daa-b128-0cd7a87de824]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:32 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 Jul 09 17:16:32 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:32 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Deleted volume successfully. Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d6cad433-d393-4586-80fc-a6a75187b512 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-3a44e1e7-1fad-4606-85c0-17a2a44bd9e2-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:32 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 1073741824" returned: 0 in 1.226s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:32 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 Jul 09 17:16:32 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (73792643-640c-4e39-a3b4-f95845b0d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:33 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac8fbfb-58b1-4729-834e-f851a002d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53" returned: 0 in 1.155s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac8fbfb-58b1-4729-834e-f851a002d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629350111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f631fe8-56bf-4238-b80e-51ad100ef999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:33Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53 Jul 09 17:16:33 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9578ae94-8652-45d5-bca5-b900e084c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9578ae94-8652-45d5-bca5-b900e084c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e09478-3a87-4648-9a1e-f3ee5975cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e09478-3a87-4648-9a1e-f3ee5975cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f631fe8-56bf-4238-b80e-51ad100ef999', 'volume_name': 'volume-8f631fe8-56bf-4238-b80e-51ad100ef999', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b02135c-745d-4d40-8913-1c9c278285d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b02135c-745d-4d40-8913-1c9c278285d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea546cf-1c6c-4a74-b1a0-e4cc547bc1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Volume 8f631fe8-56bf-4238-b80e-51ad100ef999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f631fe8-56bf-4238-b80e-51ad100ef999', 'volume_size': 1} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:33 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" returned: 0 in 0.888s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629350111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f631fe8-56bf-4238-b80e-51ad100ef999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:33Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Creating volume 8f631fe8-56bf-4238-b80e-51ad100ef999 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=210,cinder:DELETE=20,cinder:SELECT=145,cinder:INSERT=57 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:16:33 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 1073741824 Jul 09 17:16:33 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e03f0a-8a23-489d-a377-b52313a2d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9f411-f85b-4ccf-a141-d1e3f2c93f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:INSERT=67,cinder:UPDATE=202,cinder:SELECT=147,cinder:DELETE=15 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:16:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Volume volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 (92f196a1-7537-4d09-9fa0-c9f0d1fa7017): created successfully Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9f411-f85b-4ccf-a141-d1e3f2c93f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (109a0521-1613-414e-98c3-53a4a6e80b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b0662edf-3a57-4623-b2f3-518df0d6d673 tempest-VolumesListAdminTestJSON-1682299331 None] Created volume successfully. Jul 09 17:16:34 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a20d7157-ad36-48ec-a333-0e5088427c53" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-a20d7157-ad36-48ec-a333-0e5088427c53" released by "delete_volume" :: held 2.028s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Created reservations ['c48daf5a-8fbf-4cec-980b-0df735850213', '9b26ded3-42d0-4633-a725-f6fd32184c3c', 'd1260ac0-11b9-4137-8481-0470d670326a', 'b4e91b7d-390c-4682-a7e1-fc989021405b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:34 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:34 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "cinder-quobyte-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ffbe1-d48d-4cb4-9458-682857dbce12]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:34 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 Jul 09 17:16:34 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:34 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 1073741824" returned: 0 in 1.189s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:34 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 Jul 09 17:16:34 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (7608948b-2243-4cbb-b5fe-2421c2090b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4caec4f-b14f-4d8b-9b91-ab302a060ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4caec4f-b14f-4d8b-9b91-ab302a060ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424931971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa7431fe-ee62-43bb-8db8-846d28c72ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:35Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa238554-efca-457a-a711-0802d2411f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa238554-efca-457a-a711-0802d2411f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9be483-b6a9-4f80-961f-e8966ec4c661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9be483-b6a9-4f80-961f-e8966ec4c661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa7431fe-ee62-43bb-8db8-846d28c72ef1', 'volume_name': 'volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b885cb8-dd41-4f9f-9914-33d90b9a49e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b885cb8-dd41-4f9f-9914-33d90b9a49e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3cc62-7ee2-4469-bf37-d0c241a5c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Volume aa7431fe-ee62-43bb-8db8-846d28c72ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1', 'volume_size': 1} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.091s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Deleted volume successfully. Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7481af27-3499-4c6f-a64c-e6e8b402ec89 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-a20d7157-ad36-48ec-a333-0e5088427c53-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:35 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" returned: 0 in 1.104s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:35 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999" returned: 0 in 0.876s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424931971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa7431fe-ee62-43bb-8db8-846d28c72ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:35Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Creating volume aa7431fe-ee62-43bb-8db8-846d28c72ef1 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:35 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8 Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:35 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:35 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:35 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 1073741824 Jul 09 17:16:35 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea546cf-1c6c-4a74-b1a0-e4cc547bc1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f631fe8-56bf-4238-b80e-51ad100ef999', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ea18c-b115-4c06-896d-66277b53791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Volume volume-8f631fe8-56bf-4238-b80e-51ad100ef999 (8f631fe8-56bf-4238-b80e-51ad100ef999): created successfully Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ea18c-b115-4c06-896d-66277b53791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (73792643-640c-4e39-a3b4-f95845b0d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b84549da-e5da-415e-9567-06bc19b9f940 tempest-ProjectReaderTests-1157103117 None] Created volume successfully. Jul 09 17:16:36 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-quobyte-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8" released by "delete_volume" :: held 1.854s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Created reservations ['fe5309a3-0931-4824-91aa-0fe013260108', 'a79e2ef9-c140-4f4d-9cd7-ac370747f28d', '196e5f54-c602-42e8-8a7b-cff4be49a056', '5c329853-407e-4ebe-bae8-efcfd2d21a5c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-8f631fe8-56bf-4238-b80e-51ad100ef999-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-8f631fe8-56bf-4238-b80e-51ad100ef999-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-quobyte-8f631fe8-56bf-4238-b80e-51ad100ef999" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-8f631fe8-56bf-4238-b80e-51ad100ef999" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:36 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:36 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe107a8-127a-4a5d-8c5d-042e4b36d0b4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:36 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 1073741824" returned: 0 in 1.002s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:36 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 Jul 09 17:16:36 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:36 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 Jul 09 17:16:36 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:37 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Deleted volume successfully. Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-58135c67-b279-436c-bd1c-7656eb012922 tempest-CreateVolumesFromImageTest-1713563063 None] Lock "cinder-bd8e56cb-fb9c-4b6f-98b8-930e74f1d6a8-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:37 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:37 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999" returned: 0 in 0.980s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1" returned: 0 in 0.899s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:37 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999 Jul 09 17:16:37 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3cc62-7ee2-4469-bf37-d0c241a5c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a3af0-67ee-4729-864e-4ce836e90aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Volume volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 (aa7431fe-ee62-43bb-8db8-846d28c72ef1): created successfully Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a3af0-67ee-4729-864e-4ce836e90aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (7608948b-2243-4cbb-b5fe-2421c2090b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0f18e86c-ed13-4954-b666-a6ecfde2d80e tempest-VolumesListAdminTestJSON-1682299331 None] Created volume successfully. Jul 09 17:16:38 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f631fe8-56bf-4238-b80e-51ad100ef999" returned: 0 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-8f631fe8-56bf-4238-b80e-51ad100ef999" released by "delete_volume" :: held 1.818s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Created reservations ['892860f1-84a8-44d3-bb3b-2551c592edb7', '79b3caa2-52db-4d9c-bed6-86de4466cb7d', '45773a4d-8aae-47eb-a157-39fe591e94c0', 'f8e610c5-3c84-48d2-a83c-b81ffce1c100'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:38 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:38 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (987857d4-c8ef-484a-b682-f5eae9e86c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679a3377-0e6d-48e0-93d8-66b88781ba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679a3377-0e6d-48e0-93d8-66b88781ba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136265029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5d00e-648e-4881-bb08-4c0c69abd6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:40Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f23852a-4e5f-4be4-9ee3-e39662a93d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f23852a-4e5f-4be4-9ee3-e39662a93d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c732f060-0737-4cd7-81b3-d1f4d119e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c732f060-0737-4cd7-81b3-d1f4d119e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff5d00e-648e-4881-bb08-4c0c69abd6d3', 'volume_name': 'volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2d929d-4260-499e-9552-e2b6edbff628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2d929d-4260-499e-9552-e2b6edbff628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf37524-08e8-459a-8afb-89b89ee56b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Volume 6ff5d00e-648e-4881-bb08-4c0c69abd6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3', 'volume_size': 1} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136265029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5d00e-648e-4881-bb08-4c0c69abd6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58df070fbe784e24a7d561fec5a3ca53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:40Z,use_quota=True,user_id='b5a8f4ff2ed347f3a69e79228b363d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Creating volume 6ff5d00e-648e-4881-bb08-4c0c69abd6d3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:39 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:39 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 1073741824 Jul 09 17:16:39 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (78ba3f67-ef23-49a6-8468-24d866fc4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c6f2b-967e-4548-a428-949838359fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.350s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Deleted volume successfully. Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c6f2b-967e-4548-a428-949838359fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159474568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929c85f-31d4-4f31-98d3-25f863dea08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:40Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f05f6f6-8d0b-43aa-aa5d-63d75b553e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f05f6f6-8d0b-43aa-aa5d-63d75b553e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e006ad6f-9662-44e6-82e8-dc73ec295227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e006ad6f-9662-44e6-82e8-dc73ec295227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8929c85f-31d4-4f31-98d3-25f863dea08e', 'volume_name': 'volume-8929c85f-31d4-4f31-98d3-25f863dea08e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d0636-15c8-4308-bbf9-b1775d2e5501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d0636-15c8-4308-bbf9-b1775d2e5501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5790a8-0166-4fa6-a626-288826379063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Volume 8929c85f-31d4-4f31-98d3-25f863dea08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8929c85f-31d4-4f31-98d3-25f863dea08e', 'volume_size': 1} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-166281f8-f11f-48d5-92a4-039390902d97 tempest-ProjectReaderTests-1157103117 None] Lock "cinder-8f631fe8-56bf-4238-b80e-51ad100ef999-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Flow 'volume_create_manager' (e949902a-5452-4b16-b713-b5f285e727c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034c6fbb-5d0f-473c-81c4-b221640ffa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034c6fbb-5d0f-473c-81c4-b221640ffa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129129486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151565f8-1f21-48fb-aeae-e5983b2f1aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3ab51869d241a88896fe47a52cdd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:41Z,use_quota=True,user_id='d0dd82dfa847495da6a97967f272f3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f68a9c-43ed-4b35-aa20-97f414b79b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f68a9c-43ed-4b35-aa20-97f414b79b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97b4945-7070-41d6-8943-431150f337ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97b4945-7070-41d6-8943-431150f337ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151565f8-1f21-48fb-aeae-e5983b2f1aa3', 'volume_name': 'volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061576d1-46e3-4deb-b2be-e36969bc9dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061576d1-46e3-4deb-b2be-e36969bc9dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92664fbd-bfa4-42cd-ae77-9f3a6a3184b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Volume 151565f8-1f21-48fb-aeae-e5983b2f1aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3', 'volume_size': 1} Jul 09 17:16:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:41 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 1073741824" returned: 0 in 1.271s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:41 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 Jul 09 17:16:41 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:41 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" returned: 0 in 0.710s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159474568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929c85f-31d4-4f31-98d3-25f863dea08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:40Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Creating volume 8929c85f-31d4-4f31-98d3-25f863dea08e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:41 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf37524-08e8-459a-8afb-89b89ee56b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:41 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e 1073741824 Jul 09 17:16:41 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be0175-ddbe-4a9c-ac5e-f28130601222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:41 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Volume volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 (6ff5d00e-648e-4881-bb08-4c0c69abd6d3): created successfully Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be0175-ddbe-4a9c-ac5e-f28130601222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Flow 'volume_create_manager' (987857d4-c8ef-484a-b682-f5eae9e86c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2ca3fa40-6f14-4d17-844e-2bb8f766a9a3 tempest-VolumesListAdminTestJSON-1682299331 None] Created volume successfully. Jul 09 17:16:42 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e 1073741824" returned: 0 in 0.938s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:42 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e Jul 09 17:16:42 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Flow 'volume_create_manager' (1492efc3-5222-4e03-8b97-0d1d40717a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f5447c-f483-4a98-91df-93c7164ff094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f5447c-f483-4a98-91df-93c7164ff094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18963066-2afb-4fac-9da2-708cec9d58fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0d1425209c4b64aebb3b923b18d727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:43Z,use_quota=True,user_id='ef909e72c66a4470a2bc328fc09c5cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e3b354-f98d-496e-a616-761980ea76cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e3b354-f98d-496e-a616-761980ea76cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b58171-e2d0-4c5a-a834-c02990e8db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b58171-e2d0-4c5a-a834-c02990e8db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18963066-2afb-4fac-9da2-708cec9d58fd', 'volume_name': 'volume-18963066-2afb-4fac-9da2-708cec9d58fd', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070cda9b-67d2-4ae7-9d12-88fd1b570be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070cda9b-67d2-4ae7-9d12-88fd1b570be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a273ee-6f62-4732-9e19-e6e9b3313a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Volume 18963066-2afb-4fac-9da2-708cec9d58fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18963066-2afb-4fac-9da2-708cec9d58fd', 'volume_size': 1} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:43 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e" returned: 0 in 0.724s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129129486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151565f8-1f21-48fb-aeae-e5983b2f1aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3ab51869d241a88896fe47a52cdd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:41Z,use_quota=True,user_id='d0dd82dfa847495da6a97967f272f3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Creating volume 151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:43 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5790a8-0166-4fa6-a626-288826379063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8929c85f-31d4-4f31-98d3-25f863dea08e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b266cd94-0cb7-4523-9c4c-dcb2626865bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:43 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 1073741824 Jul 09 17:16:43 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:43 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Volume volume-8929c85f-31d4-4f31-98d3-25f863dea08e (8929c85f-31d4-4f31-98d3-25f863dea08e): created successfully Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b266cd94-0cb7-4523-9c4c-dcb2626865bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (78ba3f67-ef23-49a6-8468-24d866fc4f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c713d1d1-0912-4eea-93b4-e1392e542972 tempest-ProjectReaderTests-1157103117 None] Created volume successfully. Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-8929c85f-31d4-4f31-98d3-25f863dea08e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "cinder-8929c85f-31d4-4f31-98d3-25f863dea08e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-quobyte-8929c85f-31d4-4f31-98d3-25f863dea08e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-8929c85f-31d4-4f31-98d3-25f863dea08e" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a6b7b-331d-4e99-9d9e-f8513ac835e0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:44 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e Jul 09 17:16:44 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:44 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 1073741824" returned: 0 in 1.110s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:44 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:16:44 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:45 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e" returned: 0 in 0.987s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:45 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e Jul 09 17:16:45 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:45 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.978s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18963066-2afb-4fac-9da2-708cec9d58fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0d1425209c4b64aebb3b923b18d727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:43Z,use_quota=True,user_id='ef909e72c66a4470a2bc328fc09c5cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Creating volume 18963066-2afb-4fac-9da2-708cec9d58fd {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:45 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92664fbd-bfa4-42cd-ae77-9f3a6a3184b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:45 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd 1073741824 Jul 09 17:16:45 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f9356b-ce3e-4d96-97cb-13e0f20dd9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Volume volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 (151565f8-1f21-48fb-aeae-e5983b2f1aa3): created successfully Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f9356b-ce3e-4d96-97cb-13e0f20dd9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Flow 'volume_create_manager' (e949902a-5452-4b16-b713-b5f285e727c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-46388e00-9a13-4242-a6ed-434518ead8eb tempest-VolumeDependencyTests-1468580918 None] Created volume successfully. Jul 09 17:16:46 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8929c85f-31d4-4f31-98d3-25f863dea08e" returned: 0 in 0.782s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-8929c85f-31d4-4f31-98d3-25f863dea08e" released by "delete_volume" :: held 1.816s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Created reservations ['c086a5dd-b90f-42f2-a32b-6a7a5aeaec7b', 'ed3410fa-bb44-40a1-b3c3-a6146e4336e3', '080b0316-64c6-4400-9ada-4bd160f8624d', '0dc5722e-1e09-454a-9ff4-1a1fa5b0fb0f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:46 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:46 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:46 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd 1073741824" returned: 0 in 1.135s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:47 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd Jul 09 17:16:47 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (25f1c9d7-484a-4540-a3fb-67ea7b014290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf253ecd-3507-4178-8f45-681f452701cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf253ecd-3507-4178-8f45-681f452701cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a6aca2-585e-4fbf-a963-aa47307e6f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:47Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04fbc0-eb80-4391-ade1-ccbd5e0eff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04fbc0-eb80-4391-ade1-ccbd5e0eff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1dfab-f515-4c13-904d-a47d2a36256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1dfab-f515-4c13-904d-a47d2a36256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a6aca2-585e-4fbf-a963-aa47307e6f5d', 'volume_name': 'volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cea29a7-f342-45df-b64a-b4916ccaf797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cea29a7-f342-45df-b64a-b4916ccaf797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2300118-f176-48a7-9291-ce75ee275d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Volume 08a6aca2-585e-4fbf-a963-aa47307e6f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d', 'volume_size': 1} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:47 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.171s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Deleted volume successfully. Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-613d2aeb-c316-4bca-be8d-628281a9142f tempest-ProjectReaderTests-1157103117 None] Lock "cinder-8929c85f-31d4-4f31-98d3-25f863dea08e-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:47 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd" returned: 0 in 0.744s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.185s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Creating offline snapshot 26aa36ab-cece-49fc-abdd-829e4198590e of volume 151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a273ee-6f62-4732-9e19-e6e9b3313a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18963066-2afb-4fac-9da2-708cec9d58fd', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602e3044-0d52-42d0-976e-467f3b97a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b21b747-adfe-4c8d-915a-33df85080696]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Volume volume-18963066-2afb-4fac-9da2-708cec9d58fd (18963066-2afb-4fac-9da2-708cec9d58fd): created successfully Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602e3044-0d52-42d0-976e-467f3b97a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Flow 'volume_create_manager' (1492efc3-5222-4e03-8b97-0d1d40717a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-de46e2ec-c55c-48c5-84ea-666305b40e56 tempest-VolumesListAdminTestJSON-782110904 None] Created volume successfully. Jul 09 17:16:47 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:16:47 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:48 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:48 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e 1G Jul 09 17:16:48 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Acquiring lock "cinder-18963066-2afb-4fac-9da2-708cec9d58fd-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "cinder-18963066-2afb-4fac-9da2-708cec9d58fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Acquiring lock "cinder-quobyte-18963066-2afb-4fac-9da2-708cec9d58fd" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "cinder-quobyte-18963066-2afb-4fac-9da2-708cec9d58fd" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[414d2240-f86b-4155-af06-07a9b65e7fab]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-6ff5d00e-648e-4881-bb08-4c0c69abd6d3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-6ff5d00e-648e-4881-bb08-4c0c69abd6d3-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-quobyte-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:49 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd Jul 09 17:16:49 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c607329-cbaa-47b3-82ef-5d7ead68496c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:49 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 Jul 09 17:16:49 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:49 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e 1G" returned: 0 in 1.309s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:49 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:16:49 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:50 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd" returned: 0 in 1.402s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:50 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd Jul 09 17:16:50 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:50 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" returned: 0 in 1.249s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:50 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3 Jul 09 17:16:50 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:50 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 0.978s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:50 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e is being set with open permissions: ugo+rw Jul 09 17:16:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:50 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:16:50 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:51 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" returned: 0 in 1.078s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-6ff5d00e-648e-4881-bb08-4c0c69abd6d3" released by "delete_volume" :: held 2.399s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:51 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-18963066-2afb-4fac-9da2-708cec9d58fd" returned: 0 in 1.305s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "cinder-quobyte-18963066-2afb-4fac-9da2-708cec9d58fd" released by "delete_volume" :: held 2.795s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:51 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 0.973s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Created reservations ['43fce224-e493-4945-a172-f69989c30527', 'f837d54a-40ec-409a-a39e-6f7cbab53a3f', 'a6598a58-f997-49d1-8009-b18fb23087f8', 'bee6cf1b-d7b6-41bd-b5f6-d873e30769d1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:51 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Created reservations ['b8049a47-f246-4fe0-b4a3-86ea9dfa4955', '86b6c0dc-7901-4db8-b359-627dc8741144', '92f25d73-84a3-4581-a198-8a6e53bdada6', '0446f6e5-dbe2-4239-b011-8a95139a5efa'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:51 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info Jul 09 17:16:51 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:52 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:52 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:52 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:52 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:52 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info" returned: 0 in 1.027s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:52 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info is being set with open permissions: ugo+rw Jul 09 17:16:52 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:53 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.940s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.873s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:53 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info Jul 09 17:16:53 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Deleted volume successfully. Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-aa7431fe-ee62-43bb-8db8-846d28c72ef1-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1da13624-153d-4b8d-9c8e-4a3f8b0b8e4c tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-6ff5d00e-648e-4881-bb08-4c0c69abd6d3-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-aa7431fe-ee62-43bb-8db8-846d28c72ef1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Deleted volume successfully. Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-quobyte-aa7431fe-ee62-43bb-8db8-846d28c72ef1" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-aa7431fe-ee62-43bb-8db8-846d28c72ef1" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f73bc50e-1e4a-458c-afad-06748d4d3e50 tempest-VolumesListAdminTestJSON-782110904 None] Lock "cinder-18963066-2afb-4fac-9da2-708cec9d58fd-delete_volume" released by "delete_volume" :: held 4.305s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b206020-cf03-4599-a19e-61b7a0bd678f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:53 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 Jul 09 17:16:53 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:53 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.info" returned: 0 in 0.898s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.171s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.602s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058947373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a6aca2-585e-4fbf-a963-aa47307e6f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0238bafdf942038a574447552b143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:47Z,use_quota=True,user_id='d5c2770f9fbd408b9be798d0c1c90c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Creating volume 08a6aca2-585e-4fbf-a963-aa47307e6f5d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:53 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:16:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:53 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d 1073741824 Jul 09 17:16:53 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c824d510-fef8-491b-b608-dc84e18d5003 tempest-VolumeDependencyTests-1468580918 None] Create snapshot completed successfully Jul 09 17:16:54 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:54 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1 Jul 09 17:16:54 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:54 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d 1073741824" returned: 0 in 0.891s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:54 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aa7431fe-ee62-43bb-8db8-846d28c72ef1" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-aa7431fe-ee62-43bb-8db8-846d28c72ef1" released by "delete_volume" :: held 1.629s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:54 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d Jul 09 17:16:54 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Created reservations ['bdc2b27f-6f20-451a-8b7a-fa784e5b8189', 'c4e7d7a0-f6e0-4814-89b9-2b85c039f3cf', '470244ad-8947-4410-a881-3e1b918e2440', '1ad9ca91-cc62-40b6-b6d5-4ff0d3ae9066'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:55 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:55 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-92f196a1-7537-4d09-9fa0-c9f0d1fa7017-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-92f196a1-7537-4d09-9fa0-c9f0d1fa7017-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "cinder-quobyte-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eea50d-8fde-424f-81f9-7f2b09bf565c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:16:55 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d" returned: 0 in 1.121s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:16:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Flow 'volume_create_manager' (f6149ee5-601f-47b7-a5e4-e1224eac88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bc3db5-99de-4b7d-aa99-377b0b3ee41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2300118-f176-48a7-9291-ce75ee275d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 Jul 09 17:16:56 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948000fa-cbe5-460a-bbcf-b58b1ed6c8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bc3db5-99de-4b7d-aa99-377b0b3ee41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-601760859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12de987d-65ff-40d4-9efb-33cc5e900242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3ab51869d241a88896fe47a52cdd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26aa36ab-cece-49fc-abdd-829e4198590e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:16:56Z,use_quota=True,user_id='d0dd82dfa847495da6a97967f272f3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276b041-e2c4-461c-a0cd-6ccd29b85f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c276b041-e2c4-461c-a0cd-6ccd29b85f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0a1df-d750-4a3f-8657-9f8016bf1eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0a1df-d750-4a3f-8657-9f8016bf1eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12de987d-65ff-40d4-9efb-33cc5e900242', 'volume_name': 'volume-12de987d-65ff-40d4-9efb-33cc5e900242', 'volume_size': 1, 'snapshot_id': '26aa36ab-cece-49fc-abdd-829e4198590e'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3bb4e5-5014-4c9b-b7b3-9e3a57bf8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3bb4e5-5014-4c9b-b7b3-9e3a57bf8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe4e1cc-2904-4b97-bd65-75587764e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:16:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Volume 12de987d-65ff-40d4-9efb-33cc5e900242: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12de987d-65ff-40d4-9efb-33cc5e900242', 'volume_size': 1, 'snapshot_id': '26aa36ab-cece-49fc-abdd-829e4198590e'} Jul 09 17:16:56 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Volume volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d (08a6aca2-585e-4fbf-a963-aa47307e6f5d): created successfully Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948000fa-cbe5-460a-bbcf-b58b1ed6c8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Flow 'volume_create_manager' (25f1c9d7-484a-4540-a3fb-67ea7b014290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.125s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e-12de987d-65ff-40d4-9efb-33cc5e900242" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Deleted volume successfully. Jul 09 17:16:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b703a7f7-9d58-4bbf-9cc5-4a3f7837eca6 tempest-ProjectReaderTests-1157103117 None] Created volume successfully. Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e-12de987d-65ff-40d4-9efb-33cc5e900242" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Creating volume 12de987d-65ff-40d4-9efb-33cc5e900242 from snapshot 26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a106703c-8fa5-4b2d-b537-fa7cf8967a46 tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-aa7431fe-ee62-43bb-8db8-846d28c72ef1-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] snapshot: 26aa36ab-cece-49fc-abdd-829e4198590e, volume: 12de987d-65ff-40d4-9efb-33cc5e900242, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[33039e24-3f71-4c00-a635-fc4f0691e58b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-08a6aca2-585e-4fbf-a963-aa47307e6f5d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "cinder-08a6aca2-585e-4fbf-a963-aa47307e6f5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Acquiring lock "cinder-quobyte-08a6aca2-585e-4fbf-a963-aa47307e6f5d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-08a6aca2-585e-4fbf-a963-aa47307e6f5d" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[766970fc-eb59-44ee-a172-25fded6b6608]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:56 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:16:56 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:56 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d Jul 09 17:16:56 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:56 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" returned: 0 in 1.136s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:56 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017 Jul 09 17:16:56 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:57 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 1.076s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26897be-8e2e-4a64-ab9d-125b1e0cc8c4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:57 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d" returned: 0 in 0.949s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:57 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d Jul 09 17:16:57 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:57 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:16:57 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:57 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" returned: 0 in 0.741s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-quobyte-92f196a1-7537-4d09-9fa0-c9f0d1fa7017" released by "delete_volume" :: held 1.961s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Created reservations ['5968fa68-6383-41fe-894c-8a43829e9ad0', '5742eca4-8467-49be-b15e-816318fd817b', 'c0ad2f7a-823c-4013-99bf-05d48948cf5c', '0674f214-d904-48e8-82fd-a4405876e955'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:57 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:57 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:58 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-08a6aca2-585e-4fbf-a963-aa47307e6f5d" returned: 0 in 1.070s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "cinder-quobyte-08a6aca2-585e-4fbf-a963-aa47307e6f5d" released by "delete_volume" :: held 2.086s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Created reservations ['1f96dcea-fda0-4072-b537-2c68b3996051', 'e207db02-b2ea-4b0d-b842-53e4fa14f508', 'a9ece1b5-b4ff-4af5-9bb3-d73e4815cac0', '24aae278-aa91-4ccb-b387-9942303bba79'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:58 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:16:58 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:58 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 1.431s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:16:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:16:58 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 Jul 09 17:16:58 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:16:59 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.369s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Deleted volume successfully. Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-140ae38d-18fe-4343-9da9-a4c0eccddb6b tempest-VolumesListAdminTestJSON-1682299331 None] Lock "cinder-92f196a1-7537-4d09-9fa0-c9f0d1fa7017-delete_volume" released by "delete_volume" :: held 3.687s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:16:59 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.815s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:16:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Deleted volume successfully. Jul 09 17:16:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c364950-575f-4fb5-8eac-a765d5ca1efa tempest-ProjectReaderTests-1157103117 None] Lock "cinder-08a6aca2-585e-4fbf-a963-aa47307e6f5d-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:00 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:00 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:01 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.319s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:17:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:17:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:17:05 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242" returned: 0 in 6.531s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:05 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c7b55-ac7a-445c-a4d6-57e5a8d844b2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:05 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:17:05 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:06 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.964s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:06 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:17:06 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Converted 1024.00 MB image at 156.76 MB/s Jul 09 17:17:06 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 is being set with open permissions: ugo+rw Jul 09 17:17:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:06 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 Jul 09 17:17:06 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:07 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242" returned: 0 in 0.725s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" released by "_copy_volume_from_snapshot" :: held 10.863s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e-12de987d-65ff-40d4-9efb-33cc5e900242" released by "_create_volume_from_snapshot" :: held 10.938s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.972s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe4e1cc-2904-4b97-bd65-75587764e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12de987d-65ff-40d4-9efb-33cc5e900242', 'volume_size': 1, 'snapshot_id': '26aa36ab-cece-49fc-abdd-829e4198590e'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcd6152-afe7-49e0-b8db-b93693fc5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:07 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Volume volume-12de987d-65ff-40d4-9efb-33cc5e900242 (12de987d-65ff-40d4-9efb-33cc5e900242): created successfully Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcd6152-afe7-49e0-b8db-b93693fc5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:07 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Flow 'volume_create_manager' (f6149ee5-601f-47b7-a5e4-e1224eac88c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:07 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-46e8f8ab-9875-4ba4-8cf0-67447924ce16 tempest-VolumeDependencyTests-1468580918 None] Created volume successfully. Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-26aa36ab-cece-49fc-abdd-829e4198590e-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-26aa36ab-cece-49fc-abdd-829e4198590e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Deleting offline snapshot 26aa36ab-cece-49fc-abdd-829e4198590e of volume 151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] snapshot_file for this snap is: volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12206a-3669-4586-8f7a-4fcc2259f5c0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:08 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:17:08 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:09 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 0.796s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8714ac-5749-4dac-ae8f-8f4d4d2a30f7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:09 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:17:09 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Flow 'volume_create_manager' (2e1dbcf3-786f-4cd6-89e7-5a1fda8dd9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5b5f9f-df99-4ab5-9198-71b630abed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5b5f9f-df99-4ab5-9198-71b630abed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1185132716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ec35f5-022e-481b-a02a-4a23c3c3abc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43aa64691324e99b3b673db705bf5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:10Z,use_quota=True,user_id='c8dd70da83aa4b68a5f5913619be7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a9e53-0e62-4293-9f86-bbe328999fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a9e53-0e62-4293-9f86-bbe328999fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12063898-c1cc-4834-8f12-ef997b9503eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12063898-c1cc-4834-8f12-ef997b9503eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ec35f5-022e-481b-a02a-4a23c3c3abc8', 'volume_name': 'volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f849b54-37fe-4eb3-a820-309cf1fb200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f849b54-37fe-4eb3-a820-309cf1fb200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0be62d-3cf4-4cce-bbdf-4cf539988bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Volume 41ec35f5-022e-481b-a02a-4a23c3c3abc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8', 'volume_size': 1} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1185132716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ec35f5-022e-481b-a02a-4a23c3c3abc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43aa64691324e99b3b673db705bf5a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:10Z,use_quota=True,user_id='c8dd70da83aa4b68a5f5913619be7f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Creating volume 41ec35f5-022e-481b-a02a-4a23c3c3abc8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:09 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:09 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 1073741824 Jul 09 17:17:09 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:10 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.764s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:10 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:17:10 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:10 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 1073741824" returned: 0 in 0.857s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:10 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 Jul 09 17:17:10 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:10 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 0.814s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:10 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e Jul 09 17:17:10 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:11 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0be62d-3cf4-4cce-bbdf-4cf539988bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c689d-b8e3-49bc-8e18-a2fb94fb7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Volume volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 (41ec35f5-022e-481b-a02a-4a23c3c3abc8): created successfully Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c689d-b8e3-49bc-8e18-a2fb94fb7256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Flow 'volume_create_manager' (2e1dbcf3-786f-4cd6-89e7-5a1fda8dd9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9017fa02-931a-4e0a-a245-56a77a0a68db tempest-AbsoluteLimitsTests-68158949 None] Created volume successfully. Jul 09 17:17:11 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3.26aa36ab-cece-49fc-abdd-829e4198590e" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-26aa36ab-cece-49fc-abdd-829e4198590e" released by "_delete_snapshot" :: held 3.136s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" released by "delete_snapshot" :: held 3.161s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Created reservations ['16b26fe0-d78b-4f5c-a442-70738cd8bbc8', '988b5712-d3ba-44ef-951c-331e5fcf201e', 'fbd352db-9095-47d2-829e-e0432ba968c2', 'e7dc69ea-973b-4c92-8704-94f0d71f12f6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Delete snapshot completed successfully. Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-33db6545-58f2-46ea-b8a8-bb43c9e781e2 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-26aa36ab-cece-49fc-abdd-829e4198590e-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Acquiring lock "cinder-41ec35f5-022e-481b-a02a-4a23c3c3abc8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "cinder-41ec35f5-022e-481b-a02a-4a23c3c3abc8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Acquiring lock "cinder-quobyte-41ec35f5-022e-481b-a02a-4a23c3c3abc8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "cinder-quobyte-41ec35f5-022e-481b-a02a-4a23c3c3abc8" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2f5e3-3567-4130-b461-a3f4c31b79c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:12 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 Jul 09 17:17:12 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-151565f8-1f21-48fb-aeae-e5983b2f1aa3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-151565f8-1f21-48fb-aeae-e5983b2f1aa3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92bb667-2177-4326-9874-7fce4561e274]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:12 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8" returned: 0 in 0.801s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:12 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:17:12 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:12 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8 Jul 09 17:17:12 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Flow 'volume_create_manager' (66e5e542-aed0-4467-b75b-b99fe20b412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6427d3b8-6df4-430b-b944-9c827f909d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6427d3b8-6df4-430b-b944-9c827f909d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607026792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9862057a-d402-455c-bfce-ebf666ff834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9466f15cce2b460886e427c266208336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:13Z,use_quota=True,user_id='5f91b3ad07ee4fb384b2e54c957b843a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425445d8-58aa-45d7-b5fe-b61f5386f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425445d8-58aa-45d7-b5fe-b61f5386f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a1a620-1f4b-4730-a22d-50b76ef29aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a1a620-1f4b-4730-a22d-50b76ef29aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9862057a-d402-455c-bfce-ebf666ff834c', 'volume_name': 'volume-9862057a-d402-455c-bfce-ebf666ff834c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557961c9-160e-4e60-b01a-cb4033d1ed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557961c9-160e-4e60-b01a-cb4033d1ed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de792e2-e25d-4bc4-8460-2ec008777a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Volume 9862057a-d402-455c-bfce-ebf666ff834c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9862057a-d402-455c-bfce-ebf666ff834c', 'volume_size': 1} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607026792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9862057a-d402-455c-bfce-ebf666ff834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9466f15cce2b460886e427c266208336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:13Z,use_quota=True,user_id='5f91b3ad07ee4fb384b2e54c957b843a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Creating volume 9862057a-d402-455c-bfce-ebf666ff834c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:13 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:13 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c 1073741824 Jul 09 17:17:13 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:13 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-41ec35f5-022e-481b-a02a-4a23c3c3abc8" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "cinder-quobyte-41ec35f5-022e-481b-a02a-4a23c3c3abc8" released by "delete_volume" :: held 1.574s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:13 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.887s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:13 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3 Jul 09 17:17:13 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Created reservations ['d0f7fd3d-a876-4767-bfc3-4c1c2e9dd388', '53ee7753-34fa-4468-b2b1-792074892985', 'eb7f8ac5-2c08-4d57-b553-e2a3573c6093', '932537e2-3ee3-4319-bbb3-47fa80eaea87'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:13 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:13 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:14 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c 1073741824" returned: 0 in 0.930s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:14 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-151565f8-1f21-48fb-aeae-e5983b2f1aa3" returned: 0 in 0.753s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-151565f8-1f21-48fb-aeae-e5983b2f1aa3" released by "delete_volume" :: held 1.711s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:14 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c Jul 09 17:17:14 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Created reservations ['cb48e3e6-a1ff-4aa7-a440-271986c62858', 'a942a913-05d3-4068-92e5-27d67ca64d36', 'f7cda171-5858-4277-a2e5-ff857517c4bd', '0ccd9c4a-058e-4f85-ae30-c6a9ef01f17f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:14 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Deleted volume successfully. Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3f3f72d-2ba2-4117-a46c-bacda3e8e5c8 tempest-AbsoluteLimitsTests-68158949 None] Lock "cinder-41ec35f5-022e-481b-a02a-4a23c3c3abc8-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:14 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:14 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-12de987d-65ff-40d4-9efb-33cc5e900242-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-12de987d-65ff-40d4-9efb-33cc5e900242-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9eb02b-cdfb-4907-9396-e5d050e7f753]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:15 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:15 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 Jul 09 17:17:15 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de792e2-e25d-4bc4-8460-2ec008777a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9862057a-d402-455c-bfce-ebf666ff834c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f175f4cd-3dae-4f04-b482-5b2ee96d0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Volume volume-9862057a-d402-455c-bfce-ebf666ff834c (9862057a-d402-455c-bfce-ebf666ff834c): created successfully Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f175f4cd-3dae-4f04-b482-5b2ee96d0f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Flow 'volume_create_manager' (66e5e542-aed0-4467-b75b-b99fe20b412e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4b28099a-7b93-4ee1-9af4-70bfada256d5 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Created volume successfully. Jul 09 17:17:15 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.820s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Deleted volume successfully. Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-92267aad-46e8-492c-8caa-986e068e0008 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-151565f8-1f21-48fb-aeae-e5983b2f1aa3-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:15 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242" returned: 0 in 0.837s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:15 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242 Jul 09 17:17:15 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:16 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-12de987d-65ff-40d4-9efb-33cc5e900242" returned: 0 in 0.758s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-quobyte-12de987d-65ff-40d4-9efb-33cc5e900242" released by "delete_volume" :: held 1.667s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Created reservations ['48e56a7d-784a-4cce-8912-9dca8877076f', 'eae6460c-4881-4d02-add1-5523756c19af', '2ca9bacd-ec8d-4a28-b5b0-f6a7b7b933f2', '7ae9adee-cb5c-4b65-b2d2-886149ae0422'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:16 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:16 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:17 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.745s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:17 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Deleted volume successfully. Jul 09 17:17:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-70689be8-ca86-45d9-a302-0a4e2a051d48 tempest-VolumeDependencyTests-1468580918 None] Lock "cinder-12de987d-65ff-40d4-9efb-33cc5e900242-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (d083c492-8d5e-4959-a999-9e163d721fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1757ed-28f5-4d55-a9eb-224965836726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1757ed-28f5-4d55-a9eb-224965836726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-180852139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20296442-79ac-4e12-b2d9-08fe3f8e2894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0faf1f78f14df6bec8280f039eaec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:19Z,use_quota=True,user_id='361df3b97c67432d9a9cba2816472c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c44216-80d4-419e-8456-57008b7e7191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c44216-80d4-419e-8456-57008b7e7191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e2aa4f-1ffe-4edf-aeba-03eed7125c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e2aa4f-1ffe-4edf-aeba-03eed7125c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20296442-79ac-4e12-b2d9-08fe3f8e2894', 'volume_name': 'volume-20296442-79ac-4e12-b2d9-08fe3f8e2894', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c26ba3-5ea7-424a-97a2-911f4dab4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c26ba3-5ea7-424a-97a2-911f4dab4185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86719f4e-c06c-4ea5-8f16-efa4ff199353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Volume 20296442-79ac-4e12-b2d9-08fe3f8e2894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20296442-79ac-4e12-b2d9-08fe3f8e2894', 'volume_size': 1} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-180852139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20296442-79ac-4e12-b2d9-08fe3f8e2894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0faf1f78f14df6bec8280f039eaec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:19Z,use_quota=True,user_id='361df3b97c67432d9a9cba2816472c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Creating volume 20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:19 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 1073741824 Jul 09 17:17:19 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:20 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 1073741824" returned: 0 in 0.887s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:20 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 Jul 09 17:17:20 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:20 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894" returned: 0 in 0.645s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86719f4e-c06c-4ea5-8f16-efa4ff199353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20296442-79ac-4e12-b2d9-08fe3f8e2894', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c882d59b-8efc-4534-a374-58819d2b2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c212ab-50af-4641-8fe5-26679c8a5685]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Volume volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 (20296442-79ac-4e12-b2d9-08fe3f8e2894): created successfully Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c882d59b-8efc-4534-a374-58819d2b2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (d083c492-8d5e-4959-a999-9e163d721fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b506014d-29c6-410f-9673-35e945f9cdf4 tempest-VolumesDeleteCascade-1413190391 None] Created volume successfully. Jul 09 17:17:21 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c Jul 09 17:17:21 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Flow 'volume_create_manager' (49b0ec11-b75c-4f04-b924-67fc4762847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b768048-8bb3-4c24-89ea-dbf647f2996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b768048-8bb3-4c24-89ea-dbf647f2996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155826237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b658024-9563-4851-8dfd-06c1c30cc114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36c727b14d34a6b2c0af09999782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:21Z,use_quota=True,user_id='165bd71eeabf40e9b1cb19a36b3ca030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d695b260-9141-480c-b5e4-32c9dc3dbd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d695b260-9141-480c-b5e4-32c9dc3dbd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1371668-9564-4999-b5f3-f965a9736985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1371668-9564-4999-b5f3-f965a9736985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b658024-9563-4851-8dfd-06c1c30cc114', 'volume_name': 'volume-1b658024-9563-4851-8dfd-06c1c30cc114', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac464cb9-9f2e-4e76-af2d-d4984bf413f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac464cb9-9f2e-4e76-af2d-d4984bf413f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ef5b66-c519-4b1f-ba1f-2c49720a1efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Volume 1b658024-9563-4851-8dfd-06c1c30cc114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b658024-9563-4851-8dfd-06c1c30cc114', 'volume_size': 1} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:21 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c" returned: 0 in 0.830s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155826237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b658024-9563-4851-8dfd-06c1c30cc114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36c727b14d34a6b2c0af09999782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:21Z,use_quota=True,user_id='165bd71eeabf40e9b1cb19a36b3ca030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Creating volume 1b658024-9563-4851-8dfd-06c1c30cc114 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:21 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:21 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 1073741824 Jul 09 17:17:21 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-9862057a-d402-455c-bfce-ebf666ff834c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f04b626-8270-4bc8-bc20-cf6eb8b420f1', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:17:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-eeecde1b-b337-4547-95e5-ef6dcc8d174c req-a321bc93-7120-468d-89d4-000d621ea42f tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] attachment_update completed successfully. Jul 09 17:17:22 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 1073741824" returned: 0 in 0.881s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:22 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 Jul 09 17:17:22 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:23 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114" returned: 0 in 0.633s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.669s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ef5b66-c519-4b1f-ba1f-2c49720a1efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b658024-9563-4851-8dfd-06c1c30cc114', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d0c3d1-0167-40b5-9e3e-db6176730a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Creating offline snapshot f61e15e9-e8aa-437f-b2ea-6623d61d41a6 of volume 20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:17:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Volume volume-1b658024-9563-4851-8dfd-06c1c30cc114 (1b658024-9563-4851-8dfd-06c1c30cc114): created successfully Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d0c3d1-0167-40b5-9e3e-db6176730a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Flow 'volume_create_manager' (49b0ec11-b75c-4f04-b924-67fc4762847f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a66184-e5b3-4040-94c1-1e30420c3be1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b1340834-3a14-4045-a2a6-71f0330b926d tempest-ProjectReaderTests-1909160579 None] Created volume successfully. Jul 09 17:17:23 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 Jul 09 17:17:23 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Acquiring lock "cinder-1b658024-9563-4851-8dfd-06c1c30cc114-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "cinder-1b658024-9563-4851-8dfd-06c1c30cc114-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Acquiring lock "cinder-quobyte-1b658024-9563-4851-8dfd-06c1c30cc114" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "cinder-quobyte-1b658024-9563-4851-8dfd-06c1c30cc114" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[886aef09-c8b0-411d-bdfa-6fb1896f7983]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:24 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 Jul 09 17:17:24 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:24 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:24 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 1G Jul 09 17:17:24 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:24 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114" returned: 0 in 0.784s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:24 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114 Jul 09 17:17:24 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:25 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 1G" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:25 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:25 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:25 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1b658024-9563-4851-8dfd-06c1c30cc114" returned: 0 in 0.679s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "cinder-quobyte-1b658024-9563-4851-8dfd-06c1c30cc114" released by "delete_volume" :: held 1.508s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Created reservations ['33cbd185-3ab4-417b-9505-4f33baecb471', '3d3862ad-c2f9-4af6-85c9-d08b9459705c', 'd33b8868-4a55-4f9e-833b-0f75bba12dc2', 'c3c82750-5219-4803-974b-b52a818757a9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:25 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:25 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:25 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.704s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:25 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 is being set with open permissions: ugo+rw Jul 09 17:17:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:25 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:25 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:26 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:26 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Deleted volume successfully. Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-885515f8-8a48-4c05-aeda-35e267a2b68f tempest-ProjectReaderTests-1909160579 None] Lock "cinder-1b658024-9563-4851-8dfd-06c1c30cc114-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:26 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.734s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:26 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info Jul 09 17:17:26 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Flow 'volume_create_manager' (b83d5154-6db8-407e-903b-38d562c69df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a85ba3-f3de-47bd-a032-cabfd5916b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a85ba3-f3de-47bd-a032-cabfd5916b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180410449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88018e86-7f63-4e97-a135-01f48208be89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36c727b14d34a6b2c0af09999782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:27Z,use_quota=True,user_id='165bd71eeabf40e9b1cb19a36b3ca030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58999fce-6554-410d-a578-8ec010d8f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58999fce-6554-410d-a578-8ec010d8f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2a0d4b-e186-46ca-ab1b-57ddb4f505fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2a0d4b-e186-46ca-ab1b-57ddb4f505fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88018e86-7f63-4e97-a135-01f48208be89', 'volume_name': 'volume-88018e86-7f63-4e97-a135-01f48208be89', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0410457a-aad2-48c6-8b62-732a2012297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0410457a-aad2-48c6-8b62-732a2012297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d096217-e5d0-4785-ad01-6d839fcc6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Volume 88018e86-7f63-4e97-a135-01f48208be89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88018e86-7f63-4e97-a135-01f48208be89', 'volume_size': 1} Jul 09 17:17:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:27 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info" returned: 0 in 0.669s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:27 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info is being set with open permissions: ugo+rw Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:27 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info Jul 09 17:17:27 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:27 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.info" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180410449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88018e86-7f63-4e97-a135-01f48208be89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36c727b14d34a6b2c0af09999782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:27Z,use_quota=True,user_id='165bd71eeabf40e9b1cb19a36b3ca030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Creating volume 88018e86-7f63-4e97-a135-01f48208be89 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:27 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:27 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 1073741824 Jul 09 17:17:27 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d13f6d49-5f11-4d5e-a775-28dd1c7154e2 tempest-VolumesDeleteCascade-1413190391 None] Create snapshot completed successfully Jul 09 17:17:28 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 1073741824" returned: 0 in 0.844s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:28 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 Jul 09 17:17:28 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-9c3e3ac8-40b8-4d6a-be0e-c08da9711de0 req-4fb754ff-536c-4d4b-a4bd-12f275da8f3a tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Terminate volume connection completed successfully. Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-9c3e3ac8-40b8-4d6a-be0e-c08da9711de0 req-4fb754ff-536c-4d4b-a4bd-12f275da8f3a tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Deleting attachment 0f04b626-8270-4bc8-bc20-cf6eb8b420f1. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:17:29 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89" returned: 0 in 0.711s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.305s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Creating offline snapshot 66958f1f-f8d9-46c7-ad49-f46201911af7 of volume 20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d096217-e5d0-4785-ad01-6d839fcc6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88018e86-7f63-4e97-a135-01f48208be89', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d26287-a875-41d4-8403-fb655eeed4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbea9d-6eff-4c3c-a0cd-97ac8353a7da]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Volume volume-88018e86-7f63-4e97-a135-01f48208be89 (88018e86-7f63-4e97-a135-01f48208be89): created successfully Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d26287-a875-41d4-8403-fb655eeed4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Flow 'volume_create_manager' (b83d5154-6db8-407e-903b-38d562c69df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c558e5d7-e7ab-4745-9ed7-3e0b0dd4a1a2 tempest-ProjectReaderTests-1909160579 None] Created volume successfully. Jul 09 17:17:29 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:29 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Acquiring lock "cinder-88018e86-7f63-4e97-a135-01f48208be89-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "cinder-88018e86-7f63-4e97-a135-01f48208be89-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Acquiring lock "cinder-quobyte-88018e86-7f63-4e97-a135-01f48208be89" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "cinder-quobyte-88018e86-7f63-4e97-a135-01f48208be89" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aa015d-4ab7-4b81-8aac-4e5490aa91ec]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:30 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 Jul 09 17:17:30 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:30 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.808s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20296442-79ac-4e12-b2d9-08fe3f8e2894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:30 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 1G Jul 09 17:17:30 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:30 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89" returned: 0 in 0.818s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:30 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89 Jul 09 17:17:30 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:31 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 1G" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:31 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 Jul 09 17:17:31 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:31 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "cinder-9862057a-d402-455c-bfce-ebf666ff834c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-88018e86-7f63-4e97-a135-01f48208be89" returned: 0 in 0.720s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "cinder-9862057a-d402-455c-bfce-ebf666ff834c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "cinder-quobyte-88018e86-7f63-4e97-a135-01f48208be89" released by "delete_volume" :: held 1.586s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "cinder-quobyte-9862057a-d402-455c-bfce-ebf666ff834c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "cinder-quobyte-9862057a-d402-455c-bfce-ebf666ff834c" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[895c1757-1666-4445-9ef9-93d86c7a8780]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Created reservations ['c16832f7-6f17-4c36-821f-9838fbf84afd', 'd7032aa3-2c6a-4202-ae6d-824cf8d44049', '356d5eb9-dddc-447f-8131-4911c1e15093', 'b67316ce-7ee6-4641-aee1-135285e552a0'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:31 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c Jul 09 17:17:31 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:31 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:31 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:31 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7" returned: 0 in 0.730s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:31 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 is being set with open permissions: ugo+rw Jul 09 17:17:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:32 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 Jul 09 17:17:32 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:32 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c" returned: 0 in 0.837s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:32 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c Jul 09 17:17:32 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:32 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.759s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Deleted volume successfully. Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-796fde2a-cc56-4f4e-b25b-4c04d44e2805 tempest-ProjectReaderTests-1909160579 None] Lock "cinder-88018e86-7f63-4e97-a135-01f48208be89-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:32 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5dac61e6-d32c-4ab5-b65b-38d4e3edaa90 tempest-VolumesDeleteCascade-1413190391 None] Create snapshot completed successfully Jul 09 17:17:33 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9862057a-d402-455c-bfce-ebf666ff834c" returned: 0 in 0.729s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "cinder-quobyte-9862057a-d402-455c-bfce-ebf666ff834c" released by "delete_volume" :: held 1.608s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Created reservations ['a218b1f2-c762-40bc-968e-8c017a27d27c', '82f3d69b-f6c4-4bdc-80f8-9c106a87005c', '3626f9b4-6281-45cf-8ae7-0eca6cb0a82b', '6fd66d5c-f89a-44bd-9b9c-7bce38c93509'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:33 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:33 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-20296442-79ac-4e12-b2d9-08fe3f8e2894-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-20296442-79ac-4e12-b2d9-08fe3f8e2894-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Performing cascade delete. {{(pid=86876) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-66958f1f-f8d9-46c7-ad49-f46201911af7-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-66958f1f-f8d9-46c7-ad49-f46201911af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-66958f1f-f8d9-46c7-ad49-f46201911af7" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-66958f1f-f8d9-46c7-ad49-f46201911af7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Deleting offline snapshot 66958f1f-f8d9-46c7-ad49-f46201911af7 of volume 20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] snapshot_file for this snap is: volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14be54-442a-4af3-ae1f-5aa7462d820f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:33 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 Jul 09 17:17:33 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:34 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.833s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Deleted volume successfully. Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=178,cinder:DELETE=14,cinder:SELECT=119,cinder:INSERT=37 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b4718273-6ef8-4f10-a00a-e973743933b4 tempest-TestServerVolumeAttachScenarioOldVersion-1521386965 None] Lock "cinder-9862057a-d402-455c-bfce-ebf666ff834c-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:34 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20296442-79ac-4e12-b2d9-08fe3f8e2894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5301fc45-f613-458a-82ab-9a632f7e1cce]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:34 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:34 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:35 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.834s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20296442-79ac-4e12-b2d9-08fe3f8e2894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:35 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 Jul 09 17:17:35 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:36 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7" returned: 0 in 1.054s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:36 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7 Jul 09 17:17:36 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:37 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.66958f1f-f8d9-46c7-ad49-f46201911af7" returned: 0 in 0.817s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-66958f1f-f8d9-46c7-ad49-f46201911af7" released by "_delete_snapshot" :: held 3.708s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" released by "delete_snapshot" :: held 3.744s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=129,cinder:INSERT=41,cinder:UPDATE=161,cinder:DELETE=18 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['7f7bdfc7-c8ca-4d20-8d39-aae0ab3c42f6', 'df273ce3-140c-43ee-ae8c-6954a8de6f1d', '2e01da83-4994-4e15-b6d6-191f6cc52ce8', '2d992ba8-3a8b-4a69-8c19-f496266df6db'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Delete snapshot completed successfully. Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-66958f1f-f8d9-46c7-ad49-f46201911af7-delete_snapshot" released by "delete_snapshot" :: held 3.963s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-f61e15e9-e8aa-437f-b2ea-6623d61d41a6-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-f61e15e9-e8aa-437f-b2ea-6623d61d41a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-f61e15e9-e8aa-437f-b2ea-6623d61d41a6" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-f61e15e9-e8aa-437f-b2ea-6623d61d41a6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Deleting offline snapshot f61e15e9-e8aa-437f-b2ea-6623d61d41a6 of volume 20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] snapshot_file for this snap is: volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c747e-ae47-4343-a337-3c520efe199d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:37 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:37 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:38 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.818s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20296442-79ac-4e12-b2d9-08fe3f8e2894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:38 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad7368-5786-44f7-8b90-3a03a90d1961]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:38 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 Jul 09 17:17:38 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:39 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894" returned: 0 in 0.834s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:39 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:39 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:40 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.732s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:40 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6 Jul 09 17:17:40 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:40 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894.f61e15e9-e8aa-437f-b2ea-6623d61d41a6" returned: 0 in 0.650s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-f61e15e9-e8aa-437f-b2ea-6623d61d41a6" released by "_delete_snapshot" :: held 3.137s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" released by "delete_snapshot" :: held 3.161s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['32360464-c0e7-4810-9ce5-41a787e19183', '8d6173e9-f459-4d5d-8546-5d52d254027a', '3702c2db-0d9f-471d-b7e2-97674ea11d3f', 'dfce46ab-ab11-4f5a-8d19-9ff582bb15f6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Delete snapshot completed successfully. Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-f61e15e9-e8aa-437f-b2ea-6623d61d41a6-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Snapshots deleted, issuing volume delete {{(pid=86876) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea175ed5-a1d2-4ea3-b310-e9ca4e5a6e8f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:41 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 Jul 09 17:17:41 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:41 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894" returned: 0 in 0.792s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:41 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894 Jul 09 17:17:41 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:42 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-20296442-79ac-4e12-b2d9-08fe3f8e2894" returned: 0 in 0.662s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-20296442-79ac-4e12-b2d9-08fe3f8e2894" released by "delete_volume" :: held 1.522s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['a0fa07f2-ef00-49fa-ab0d-019ab8cdeb93', '879af3a1-8f1d-40ec-8f11-536be8c5319a', '713a953d-4ec5-4da3-99c8-a2f47c6f09c9', 'b8bde135-893c-4e83-aaeb-e2b1b142117b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:42 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:17:42 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:43 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.694s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:17:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Deleted volume successfully. Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5b252406-ce3a-49da-8eff-45cece909bfd tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-20296442-79ac-4e12-b2d9-08fe3f8e2894-delete_volume" released by "delete_volume" :: held 9.787s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (2915b77b-29ef-44ef-ba5c-cdf02b76784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b96e61-f07c-4513-8128-971094e8723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b96e61-f07c-4513-8128-971094e8723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333013234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7055ecef-b554-403d-aa34-f5cadf812799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0faf1f78f14df6bec8280f039eaec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:44Z,use_quota=True,user_id='361df3b97c67432d9a9cba2816472c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e79ac6e-8b41-463d-80c4-9a4f289cc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e79ac6e-8b41-463d-80c4-9a4f289cc482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3805710e-1832-46fb-9921-df0e678c0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3805710e-1832-46fb-9921-df0e678c0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7055ecef-b554-403d-aa34-f5cadf812799', 'volume_name': 'volume-7055ecef-b554-403d-aa34-f5cadf812799', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d880179a-bf3e-4198-a5f3-24a8ee4c193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d880179a-bf3e-4198-a5f3-24a8ee4c193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c48d1a-e452-44d8-9e97-7653822cba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:43 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Volume 7055ecef-b554-403d-aa34-f5cadf812799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7055ecef-b554-403d-aa34-f5cadf812799', 'volume_size': 1} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333013234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7055ecef-b554-403d-aa34-f5cadf812799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0faf1f78f14df6bec8280f039eaec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:44Z,use_quota=True,user_id='361df3b97c67432d9a9cba2816472c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Creating volume 7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:43 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:17:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:43 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 1073741824 Jul 09 17:17:43 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:44 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 1073741824" returned: 0 in 0.893s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:44 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:17:44 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:45 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.728s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c48d1a-e452-44d8-9e97-7653822cba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7055ecef-b554-403d-aa34-f5cadf812799', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d40ea1-798e-4094-8f37-107a58519197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Volume volume-7055ecef-b554-403d-aa34-f5cadf812799 (7055ecef-b554-403d-aa34-f5cadf812799): created successfully Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d40ea1-798e-4094-8f37-107a58519197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (2915b77b-29ef-44ef-ba5c-cdf02b76784e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0522cdee-a404-46e2-b58f-9d60b2d70111 tempest-VolumesDeleteCascade-1413190391 None] Created volume successfully. Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Creating offline snapshot 18986637-e105-4f64-9b51-6e014204ff32 of volume 7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[03995b55-d033-43bf-a66f-5014d7a866af]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:46 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:17:46 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:46 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:46 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 1G Jul 09 17:17:46 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:47 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 1G" returned: 0 in 0.849s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7055ecef-b554-403d-aa34-f5cadf812799 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:47 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7055ecef-b554-403d-aa34-f5cadf812799 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:17:47 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:48 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7055ecef-b554-403d-aa34-f5cadf812799 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.713s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:48 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 is being set with open permissions: ugo+rw Jul 09 17:17:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:48 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:17:48 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:49 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.643s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:49 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info Jul 09 17:17:49 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:49 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info" returned: 0 in 0.666s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:49 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info is being set with open permissions: ugo+rw Jul 09 17:17:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:49 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info Jul 09 17:17:49 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:50 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.info" returned: 0 in 0.693s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1d95685d-f682-4fb5-92fb-467b0debd07f tempest-VolumesDeleteCascade-1413190391 None] Create snapshot completed successfully Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (044ce8b6-0423-421c-aa64-bc2757dbaa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f210e5d-f00c-48d4-978a-dc58ddd5568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f210e5d-f00c-48d4-978a-dc58ddd5568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1481499887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538201a5-fa43-4591-a722-2b0403e26a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0faf1f78f14df6bec8280f039eaec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18986637-e105-4f64-9b51-6e014204ff32,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:17:52Z,use_quota=True,user_id='361df3b97c67432d9a9cba2816472c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca2299f-2974-43d2-ba66-b9a8743208ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca2299f-2974-43d2-ba66-b9a8743208ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7289747-0870-4818-b669-772719208640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7289747-0870-4818-b669-772719208640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '538201a5-fa43-4591-a722-2b0403e26a7e', 'volume_name': 'volume-538201a5-fa43-4591-a722-2b0403e26a7e', 'volume_size': 1, 'snapshot_id': '18986637-e105-4f64-9b51-6e014204ff32'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3401b7e4-d817-4814-b812-ff5a7ac878d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3401b7e4-d817-4814-b812-ff5a7ac878d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:17:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa84bcf4-45b2-4c16-bf56-b91b84c1725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:17:51 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Volume 538201a5-fa43-4591-a722-2b0403e26a7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-538201a5-fa43-4591-a722-2b0403e26a7e', 'volume_size': 1, 'snapshot_id': '18986637-e105-4f64-9b51-6e014204ff32'} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32-538201a5-fa43-4591-a722-2b0403e26a7e" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32-538201a5-fa43-4591-a722-2b0403e26a7e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Creating volume 538201a5-fa43-4591-a722-2b0403e26a7e from snapshot 18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] snapshot: 18986637-e105-4f64-9b51-6e014204ff32, volume: 538201a5-fa43-4591-a722-2b0403e26a7e, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff046a1-76a1-42b8-b1a1-4cae1549bb7e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:52 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:17:52 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:52 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7055ecef-b554-403d-aa34-f5cadf812799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ebfda-3e1a-4a71-a26e-9772c9c20b06]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:52 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:17:52 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:53 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:53 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:17:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:53 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e Jul 09 17:17:53 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:58 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e" returned: 0 in 5.266s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3ece0-dafc-4a10-848b-67e0793763c0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:17:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:17:59 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:17:59 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:17:59 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 09 17:17:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 1.052s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:17:59 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:17:59 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Converted 1024.00 MB image at 194.42 MB/s Jul 09 17:17:59 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e is being set with open permissions: ugo+rw Jul 09 17:17:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:00 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e Jul 09 17:18:00 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:00 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:18:00 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:00 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e" returned: 0 in 0.676s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" released by "_copy_volume_from_snapshot" :: held 8.624s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32-538201a5-fa43-4591-a722-2b0403e26a7e" released by "_create_volume_from_snapshot" :: held 8.662s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.679s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa84bcf4-45b2-4c16-bf56-b91b84c1725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538201a5-fa43-4591-a722-2b0403e26a7e', 'volume_size': 1, 'snapshot_id': '18986637-e105-4f64-9b51-6e014204ff32'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adc86c2-9a3a-429f-86a8-9c8d199c0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:00 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Volume volume-538201a5-fa43-4591-a722-2b0403e26a7e (538201a5-fa43-4591-a722-2b0403e26a7e): created successfully Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adc86c2-9a3a-429f-86a8-9c8d199c0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Flow 'volume_create_manager' (044ce8b6-0423-421c-aa64-bc2757dbaa21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8dcd8d7f-7b5f-48e2-815f-1cd107dbf11d tempest-VolumesDeleteCascade-1413190391 None] Created volume successfully. Jul 09 17:18:01 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:18:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:18:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:18:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-7055ecef-b554-403d-aa34-f5cadf812799-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-7055ecef-b554-403d-aa34-f5cadf812799-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Performing cascade delete. {{(pid=86876) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-18986637-e105-4f64-9b51-6e014204ff32-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-18986637-e105-4f64-9b51-6e014204ff32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Deleting offline snapshot 18986637-e105-4f64-9b51-6e014204ff32 of volume 7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] snapshot_file for this snap is: volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddba9b0-396f-427a-ae71-c783562e20da]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:18:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:02 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:18:02 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:03 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7055ecef-b554-403d-aa34-f5cadf812799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d10506-db48-4b77-88a0-7351a43b82fd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:03 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:18:03 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:03 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:03 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:18:03 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:04 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.818s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:04 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32 Jul 09 17:18:04 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:05 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799.18986637-e105-4f64-9b51-6e014204ff32" returned: 0 in 0.653s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-18986637-e105-4f64-9b51-6e014204ff32" released by "_delete_snapshot" :: held 3.198s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" released by "delete_snapshot" :: held 3.225s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['baacccdb-b3be-4547-959d-af350b9a7d73', 'a1748b80-8f98-441c-a59f-b6db12b9d010', 'a59d6a55-60b4-4cd0-9afc-2f246c3e2761', '5465acc9-e254-4770-a0c5-92049f828e85'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:18:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Delete snapshot completed successfully. Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-18986637-e105-4f64-9b51-6e014204ff32-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Snapshots deleted, issuing volume delete {{(pid=86876) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a6984-f3ed-4186-ac1a-9ad633a6c9b2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:18:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:05 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:18:05 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:06 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:06 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799 Jul 09 17:18:06 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:07 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7055ecef-b554-403d-aa34-f5cadf812799" returned: 0 in 0.647s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-7055ecef-b554-403d-aa34-f5cadf812799" released by "delete_volume" :: held 1.533s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['25d74fd9-18dc-4a10-804d-48de8fffe734', '29bf59fc-83f0-4356-850c-b76d83f2b7f5', '9727b5dc-0f7e-46df-98ca-cfdb8116c1c5', '1f6034e5-9d56-4a85-8fee-1c8efbcf9518'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:07 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:18:07 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-538201a5-fa43-4591-a722-2b0403e26a7e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-538201a5-fa43-4591-a722-2b0403e26a7e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d649ebe0-2ee1-4e23-b3f4-3a1b9e5c24e8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:07 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.678s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:18:07 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Deleted volume successfully. Jul 09 17:18:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ae4d7d62-f41f-4d2a-8e3b-326d32ac0c28 tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-7055ecef-b554-403d-aa34-f5cadf812799-delete_volume" released by "delete_volume" :: held 5.873s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:07 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e Jul 09 17:18:07 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:08 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:08 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e Jul 09 17:18:08 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:09 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-538201a5-fa43-4591-a722-2b0403e26a7e" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-quobyte-538201a5-fa43-4591-a722-2b0403e26a7e" released by "delete_volume" :: held 1.609s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Created reservations ['4af08045-6498-4f95-ac49-520ab4c9e285', '18a33116-ea81-42d9-bab0-68e86768a16d', '5b25b949-3515-475c-b01f-a89233dcc145', 'f327176c-fc4d-4e71-96ad-3f552e975328'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:09 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:18:09 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:10 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.800s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:10 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:18:10 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Deleted volume successfully. Jul 09 17:18:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-60257167-9008-4b26-a39e-37f0a625b89f tempest-VolumesDeleteCascade-1413190391 None] Lock "cinder-538201a5-fa43-4591-a722-2b0403e26a7e-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Flow 'volume_create_manager' (bceeab83-6fe1-4acd-9292-b149ea13c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f4bdcb-3a7f-4b70-8533-1127962b3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f4bdcb-3a7f-4b70-8533-1127962b3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1492329318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7503e4c8-b5f3-46f1-ac0d-50860478b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a8f829a6b04d4c93e19c1f84636682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:13Z,use_quota=True,user_id='b43e3bb10cbd4a648bc81517ddda7872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9eb300-8068-49b2-9cb6-da9737b0068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9eb300-8068-49b2-9cb6-da9737b0068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2667c41-de77-49c0-8cf6-7eba8911a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2667c41-de77-49c0-8cf6-7eba8911a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7503e4c8-b5f3-46f1-ac0d-50860478b430', 'volume_name': 'volume-7503e4c8-b5f3-46f1-ac0d-50860478b430', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bc1421-81c9-42cd-842c-731dc0d3ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bc1421-81c9-42cd-842c-731dc0d3ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6d0ce2-4fdb-402b-ab44-bf024fc61527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Volume 7503e4c8-b5f3-46f1-ac0d-50860478b430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7503e4c8-b5f3-46f1-ac0d-50860478b430', 'volume_size': 1} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1492329318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7503e4c8-b5f3-46f1-ac0d-50860478b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62a8f829a6b04d4c93e19c1f84636682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:13Z,use_quota=True,user_id='b43e3bb10cbd4a648bc81517ddda7872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Creating volume 7503e4c8-b5f3-46f1-ac0d-50860478b430 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:18:13 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:18:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:13 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 1073741824 Jul 09 17:18:13 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:14 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 1073741824" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:14 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 Jul 09 17:18:14 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:14 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6d0ce2-4fdb-402b-ab44-bf024fc61527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7503e4c8-b5f3-46f1-ac0d-50860478b430', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e88b051-084e-49f5-ac10-3c97c7befa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Volume volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 (7503e4c8-b5f3-46f1-ac0d-50860478b430): created successfully Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e88b051-084e-49f5-ac10-3c97c7befa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Flow 'volume_create_manager' (bceeab83-6fe1-4acd-9292-b149ea13c95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e191dd43-f3a2-445c-a532-2a538c44e6af tempest-VolumesNegativeTest-1801033637 None] Created volume successfully. Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Flow 'volume_create_manager' (12e97427-dbe3-4af2-aaad-4b3825e7eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0291ec-183e-4ee9-b8cc-921f35807bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0291ec-183e-4ee9-b8cc-921f35807bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-52536897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640bd073-09e9-4b39-ac9a-6d570e0af769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571ca495d1b94068abb4e4534a1c5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:15Z,use_quota=True,user_id='fc91a6919c2a4f22ba4a9c827945b79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ba242f-5445-4cde-b178-1865d67fabae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ba242f-5445-4cde-b178-1865d67fabae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbc6a57-69e3-4ae3-b964-cf86cabc53c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbc6a57-69e3-4ae3-b964-cf86cabc53c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640bd073-09e9-4b39-ac9a-6d570e0af769', 'volume_name': 'volume-640bd073-09e9-4b39-ac9a-6d570e0af769', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1f6194-6e68-4b2e-8f2e-b9d4427680f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1f6194-6e68-4b2e-8f2e-b9d4427680f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bca458-8bab-4b3b-afd1-c0d0a5ea91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume 640bd073-09e9-4b39-ac9a-6d570e0af769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640bd073-09e9-4b39-ac9a-6d570e0af769', 'volume_size': 1} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-52536897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640bd073-09e9-4b39-ac9a-6d570e0af769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571ca495d1b94068abb4e4534a1c5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:15Z,use_quota=True,user_id='fc91a6919c2a4f22ba4a9c827945b79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Creating volume 640bd073-09e9-4b39-ac9a-6d570e0af769 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:18:15 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:15 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 1073741824 Jul 09 17:18:15 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Flow 'volume_create_manager' (1bd2493c-23d3-4e1f-a664-1af922630e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79f1b81-7421-40d7-aadf-e3d0bb71eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79f1b81-7421-40d7-aadf-e3d0bb71eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1121120312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541cac37-1254-40e5-9aab-6cfda7673ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571ca495d1b94068abb4e4534a1c5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:16Z,use_quota=True,user_id='fc91a6919c2a4f22ba4a9c827945b79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1947a0-c3b1-45d4-80cf-e15792d25cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1947a0-c3b1-45d4-80cf-e15792d25cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b083949d-8bfd-4186-8070-962ee44bbff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b083949d-8bfd-4186-8070-962ee44bbff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541cac37-1254-40e5-9aab-6cfda7673ba8', 'volume_name': 'volume-541cac37-1254-40e5-9aab-6cfda7673ba8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc770ec9-42bd-4ff1-b0f1-28bb2b8ffa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc770ec9-42bd-4ff1-b0f1-28bb2b8ffa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839e378d-fd73-4693-b951-4a2111a42be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume 541cac37-1254-40e5-9aab-6cfda7673ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541cac37-1254-40e5-9aab-6cfda7673ba8', 'volume_size': 1} Jul 09 17:18:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:16 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 1073741824" returned: 0 in 1.053s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:16 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 Jul 09 17:18:16 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:17 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769" returned: 0 in 0.745s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1121120312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541cac37-1254-40e5-9aab-6cfda7673ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571ca495d1b94068abb4e4534a1c5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:16Z,use_quota=True,user_id='fc91a6919c2a4f22ba4a9c827945b79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Creating volume 541cac37-1254-40e5-9aab-6cfda7673ba8 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:18:17 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bca458-8bab-4b3b-afd1-c0d0a5ea91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640bd073-09e9-4b39-ac9a-6d570e0af769', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:17 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 1073741824 Jul 09 17:18:17 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f28b47-e820-4d9b-8f65-e65a6b4bb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume volume-640bd073-09e9-4b39-ac9a-6d570e0af769 (640bd073-09e9-4b39-ac9a-6d570e0af769): created successfully Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f28b47-e820-4d9b-8f65-e65a6b4bb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Flow 'volume_create_manager' (12e97427-dbe3-4af2-aaad-4b3825e7eedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a1d86c1b-60a5-4468-b291-37c34aad7a8b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Created volume successfully. Jul 09 17:18:18 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 1073741824" returned: 0 in 0.859s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:18 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 Jul 09 17:18:18 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:18 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839e378d-fd73-4693-b951-4a2111a42be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541cac37-1254-40e5-9aab-6cfda7673ba8', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35613865-7ce6-478e-b5ec-f38608a3b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Volume volume-541cac37-1254-40e5-9aab-6cfda7673ba8 (541cac37-1254-40e5-9aab-6cfda7673ba8): created successfully Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35613865-7ce6-478e-b5ec-f38608a3b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Flow 'volume_create_manager' (1bd2493c-23d3-4e1f-a664-1af922630e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d0f411d9-e8bb-4905-ad7c-ad8067d0afc5 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Created volume successfully. Jul 09 17:18:28 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:INSERT=13,cinder:UPDATE=54,cinder:SELECT=38,cinder:DELETE=4 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:18:28 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=47,cinder:INSERT=16,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Acquiring lock "cinder-7503e4c8-b5f3-46f1-ac0d-50860478b430-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "cinder-7503e4c8-b5f3-46f1-ac0d-50860478b430-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Acquiring lock "cinder-quobyte-7503e4c8-b5f3-46f1-ac0d-50860478b430" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "cinder-quobyte-7503e4c8-b5f3-46f1-ac0d-50860478b430" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1798332b-42b3-4380-8543-e7c82c937ce5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:18:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:45 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 Jul 09 17:18:45 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:46 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430" returned: 0 in 0.740s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:46 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430 Jul 09 17:18:46 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:47 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7503e4c8-b5f3-46f1-ac0d-50860478b430" returned: 0 in 0.619s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "cinder-quobyte-7503e4c8-b5f3-46f1-ac0d-50860478b430" released by "delete_volume" :: held 1.403s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Created reservations ['ac0a4e57-f354-46d1-8d3c-a730b9ba1971', '0845ad57-b2a1-4112-be4e-1e06260932e3', 'ae3eae88-6eec-4381-81d0-70368c3e03c9', '142e4e84-d6c6-44b0-a26a-ef690298bf5f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:47 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:18:47 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:47 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.633s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:18:47 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Deleted volume successfully. Jul 09 17:18:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e43d4d9b-293a-4c63-8f58-bcee68a0d2e5 tempest-VolumesNegativeTest-1801033637 None] Lock "cinder-7503e4c8-b5f3-46f1-ac0d-50860478b430-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:18:57 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:18:57 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (ae89704f-be1b-48e5-a7d5-d36aa05360cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13645c31-3431-42b4-9455-f624f90b1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13645c31-3431-42b4-9455-f624f90b1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1761867410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bb1753-298c-46ad-abcf-b70ca4b818c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:59Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1949f40-3755-4c7e-99c3-c6206300ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1949f40-3755-4c7e-99c3-c6206300ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e867f2fb-c050-4271-a76d-178f49092511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e867f2fb-c050-4271-a76d-178f49092511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50bb1753-298c-46ad-abcf-b70ca4b818c7', 'volume_name': 'volume-50bb1753-298c-46ad-abcf-b70ca4b818c7', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3676e140-33e8-430b-a649-3d781051f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3676e140-33e8-430b-a649-3d781051f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2909342-8252-4af8-ba33-80565d25c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:18:58 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume 50bb1753-298c-46ad-abcf-b70ca4b818c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50bb1753-298c-46ad-abcf-b70ca4b818c7', 'volume_size': 1} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1761867410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bb1753-298c-46ad-abcf-b70ca4b818c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:18:59Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating volume 50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:18:58 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:18:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:58 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 1073741824 Jul 09 17:18:58 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:59 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 09 17:18:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 1073741824" returned: 0 in 0.827s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:18:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:18:59 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 Jul 09 17:18:59 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:18:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:00 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7" returned: 0 in 0.668s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.245s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2909342-8252-4af8-ba33-80565d25c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50bb1753-298c-46ad-abcf-b70ca4b818c7', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4320d6-99aa-432a-b9c5-ae00dc907a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3122808b-6581-442f-ae26-bc3cb6cd8115]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:00 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 (50bb1753-298c-46ad-abcf-b70ca4b818c7): created successfully Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4320d6-99aa-432a-b9c5-ae00dc907a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (ae89704f-be1b-48e5-a7d5-d36aa05360cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c4798a68-73df-4808-9918-045fbd775e78 tempest-VolumesSnapshotTestJSON-1128261735 None] Created volume successfully. Jul 09 17:19:00 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 Jul 09 17:19:00 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:00 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:00 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:01 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.074s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating offline snapshot 48027c1e-62a6-4e4d-b901-4eec4c78181f of volume 50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db8aeb-ac5d-40d6-b146-14d57da1e712]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-640bd073-09e9-4b39-ac9a-6d570e0af769', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23591cf2-70da-4fce-b6d1-d570df063237', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:19:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-8233023d-0919-4fc5-967f-8b8b02a69081 req-ff4453e1-e104-476a-956d-afbd591c6a3b tempest-TestServerVolumeAttachmentScenario-1690902118 None] attachment_update completed successfully. Jul 09 17:19:01 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 Jul 09 17:19:01 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:01 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.789s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:19:01 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7" returned: 0 in 0.813s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:01 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f 1G Jul 09 17:19:01 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:02 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f 1G" returned: 0 in 0.813s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:02 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f Jul 09 17:19:02 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:03 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f" returned: 0 in 0.716s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:03 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f is being set with open permissions: ugo+rw Jul 09 17:19:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:03 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f Jul 09 17:19:03 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:04 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f" returned: 0 in 0.654s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:04 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info Jul 09 17:19:04 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:04 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info" returned: 0 in 0.634s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:04 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info is being set with open permissions: ugo+rw Jul 09 17:19:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:04 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info Jul 09 17:19:04 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:05 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.info" returned: 0 in 0.632s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.362s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0b924d26-4007-46ae-9dcd-03105020e321 tempest-VolumesSnapshotTestJSON-1128261735 None] Create snapshot completed successfully Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-48027c1e-62a6-4e4d-b901-4eec4c78181f-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-48027c1e-62a6-4e4d-b901-4eec4c78181f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-48027c1e-62a6-4e4d-b901-4eec4c78181f" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-48027c1e-62a6-4e4d-b901-4eec4c78181f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Deleting offline snapshot 48027c1e-62a6-4e4d-b901-4eec4c78181f of volume 50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] snapshot_file for this snap is: volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c4fbed-a6b4-4548-bf4e-d158ccab0664]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:06 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f Jul 09 17:19:06 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:07 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f" returned: 0 in 0.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:07 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50bb1753-298c-46ad-abcf-b70ca4b818c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:19:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[95748b40-8c9d-4667-95ef-3007ac8b81b0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:07 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 Jul 09 17:19:07 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:08 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7" returned: 0 in 0.843s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:08 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f Jul 09 17:19:08 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:08 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f" returned: 0 in 0.727s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:08 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f Jul 09 17:19:08 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:09 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7.48027c1e-62a6-4e4d-b901-4eec4c78181f" returned: 0 in 0.621s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-48027c1e-62a6-4e4d-b901-4eec4c78181f" released by "_delete_snapshot" :: held 3.054s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" released by "delete_snapshot" :: held 3.084s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:09 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['9fc0f837-37be-44f2-9e8f-0fb37a7eba0f', '680401ec-e418-4ab1-9940-f36bc46c0b0c', '1266841c-7d9a-41d8-b9f0-27b3076d9a08', '85aea344-428a-4edc-9e18-693b9e12dc45'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:09 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Delete snapshot completed successfully. Jul 09 17:19:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c7b4c83-ce0a-4a8d-a7cb-2cca49ad9844 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-48027c1e-62a6-4e4d-b901-4eec4c78181f-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (24707d35-dace-4dab-ba5e-e10395583896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365c372c-3fe0-4816-9a40-67c4eff44c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365c372c-3fe0-4816-9a40-67c4eff44c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1250295634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef46090b-e02d-4209-a763-95d330188810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:11Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34a21e8-6bf1-470a-b806-f869290eb2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34a21e8-6bf1-470a-b806-f869290eb2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267e3ec-6169-41bd-8eca-9f5986f9f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267e3ec-6169-41bd-8eca-9f5986f9f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef46090b-e02d-4209-a763-95d330188810', 'volume_name': 'volume-ef46090b-e02d-4209-a763-95d330188810', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bda25d-299b-4b8e-b609-6e99f7d1ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bda25d-299b-4b8e-b609-6e99f7d1ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31addf6b-1336-4067-a449-a03e630d7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume ef46090b-e02d-4209-a763-95d330188810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef46090b-e02d-4209-a763-95d330188810', 'volume_size': 1} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1250295634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef46090b-e02d-4209-a763-95d330188810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:11Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating volume ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:11 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:11 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 1073741824 Jul 09 17:19:11 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:12 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 1073741824" returned: 0 in 0.838s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:12 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:12 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:12 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.629s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.466s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31addf6b-1336-4067-a449-a03e630d7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef46090b-e02d-4209-a763-95d330188810', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f0e1af-7c15-4236-8c7d-18237658137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33d17d6-9242-4443-83a4-14b9c19dc606]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume volume-ef46090b-e02d-4209-a763-95d330188810 (ef46090b-e02d-4209-a763-95d330188810): created successfully Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f0e1af-7c15-4236-8c7d-18237658137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (24707d35-dace-4dab-ba5e-e10395583896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-175e55e8-c5e3-4d8b-b2ae-d1ba00ea8e44 tempest-VolumesSnapshotTestJSON-1128261735 None] Created volume successfully. Jul 09 17:19:12 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 Jul 09 17:19:12 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:13 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8" returned: 0 in 0.806s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.250s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating offline snapshot a60332c7-c38a-4e70-9edf-57b768dc58b9 of volume ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d22913-f01f-494a-a4d4-cf3eba445e1e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-541cac37-1254-40e5-9aab-6cfda7673ba8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '344fb0c5-918f-4ca2-bad8-153af15fd510', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:19:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-aa881f5f-f610-4f5e-a7a9-3b24014f2c9b req-fbc2d6f7-40f6-4120-934e-8eb0600f020d tempest-TestServerVolumeAttachmentScenario-1690902118 None] attachment_update completed successfully. Jul 09 17:19:13 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:13 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:14 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:14 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 1G Jul 09 17:19:14 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:15 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 1G" returned: 0 in 0.878s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef46090b-e02d-4209-a763-95d330188810 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:15 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef46090b-e02d-4209-a763-95d330188810 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:15 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:15 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef46090b-e02d-4209-a763-95d330188810 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.668s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:15 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 is being set with open permissions: ugo+rw Jul 09 17:19:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:15 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:15 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:16 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:16 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info Jul 09 17:19:16 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:17 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info" returned: 0 in 0.684s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:17 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info is being set with open permissions: ugo+rw Jul 09 17:19:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:17 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info Jul 09 17:19:17 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:18 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.info" returned: 0 in 0.693s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b65f2fd6-97d3-410d-b1b2-cef6b9584401 tempest-VolumesSnapshotTestJSON-1128261735 None] Create snapshot completed successfully Jul 09 17:19:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-f98298b8-94fe-44db-90f3-822b4b9469da req-f5ee4dfe-f278-4bf7-92d5-4dd8f1c15045 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Terminate volume connection completed successfully. Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-f98298b8-94fe-44db-90f3-822b4b9469da req-f5ee4dfe-f278-4bf7-92d5-4dd8f1c15045 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Deleting attachment 344fb0c5-918f-4ca2-bad8-153af15fd510. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (0b9bd420-8fbb-46f5-9d5d-c2c14876723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553032fe-dff7-4095-bab5-a2a69e108b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553032fe-dff7-4095-bab5-a2a69e108b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096900788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9163bd05-8775-496e-9336-fde228495d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a60332c7-c38a-4e70-9edf-57b768dc58b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:19Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84d212a-bef7-423d-8e6c-0a9489e475ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84d212a-bef7-423d-8e6c-0a9489e475ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dab100f-cca6-4922-be26-2bbcb53fab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dab100f-cca6-4922-be26-2bbcb53fab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9163bd05-8775-496e-9336-fde228495d43', 'volume_name': 'volume-9163bd05-8775-496e-9336-fde228495d43', 'volume_size': 2, 'snapshot_id': 'a60332c7-c38a-4e70-9edf-57b768dc58b9'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cbf0a8-2806-4b51-a740-ca48919de6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cbf0a8-2806-4b51-a740-ca48919de6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ec4fd5-d9df-428e-90bf-804b11a8227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Volume 9163bd05-8775-496e-9336-fde228495d43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9163bd05-8775-496e-9336-fde228495d43', 'volume_size': 2, 'snapshot_id': 'a60332c7-c38a-4e70-9edf-57b768dc58b9'} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9-9163bd05-8775-496e-9336-fde228495d43" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9-9163bd05-8775-496e-9336-fde228495d43" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Creating volume 9163bd05-8775-496e-9336-fde228495d43 from snapshot a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] snapshot: a60332c7-c38a-4e70-9edf-57b768dc58b9, volume: 9163bd05-8775-496e-9336-fde228495d43, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039aae9-3a65-4281-a6a1-c18e2b6e57cb]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:19 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:19 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:20 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.738s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef46090b-e02d-4209-a763-95d330188810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298b652-12c0-45a2-813f-fffbe62ef3c9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:20 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:20 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:20 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.742s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:19:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:20 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 Jul 09 17:19:20 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-06c3bdb3-ec1c-4685-8ce3-1ce68d595142 req-7c614cd6-e454-47bf-930e-a9b1e9174a4f tempest-TestServerVolumeAttachmentScenario-1690902118 None] Terminate volume connection completed successfully. Jul 09 17:19:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-06c3bdb3-ec1c-4685-8ce3-1ce68d595142 req-7c614cd6-e454-47bf-930e-a9b1e9174a4f tempest-TestServerVolumeAttachmentScenario-1690902118 None] Deleting attachment 23591cf2-70da-4fce-b6d1-d570df063237. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:19:25 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43" returned: 0 in 4.957s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ba91e-b433-4bde-89ef-2b71b1c1751a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:25 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:25 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:26 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.906s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:26 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:19:26 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Converted 1024.00 MB image at 206.51 MB/s Jul 09 17:19:26 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 is being set with open permissions: ugo+rw Jul 09 17:19:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:26 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 Jul 09 17:19:26 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:27 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" released by "_copy_volume_from_snapshot" :: held 8.181s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9-9163bd05-8775-496e-9336-fde228495d43" released by "_create_volume_from_snapshot" :: held 8.209s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.224s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ec4fd5-d9df-428e-90bf-804b11a8227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9163bd05-8775-496e-9336-fde228495d43', 'volume_size': 2, 'snapshot_id': 'a60332c7-c38a-4e70-9edf-57b768dc58b9'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faacb55-d327-4f1c-af48-2304b407a1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Volume volume-9163bd05-8775-496e-9336-fde228495d43 (9163bd05-8775-496e-9336-fde228495d43): created successfully Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faacb55-d327-4f1c-af48-2304b407a1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (0b9bd420-8fbb-46f5-9d5d-c2c14876723c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-432a837f-0c94-4791-8b98-28e0b045c6dd tempest-VolumesSnapshotTestJSON-1128261735 None] Created volume successfully. Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-9163bd05-8775-496e-9336-fde228495d43-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-9163bd05-8775-496e-9336-fde228495d43-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8a70df-b143-4e3d-9f56-583735e11eaa]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:28 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 Jul 09 17:19:28 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:28 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43" returned: 0 in 0.901s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:29 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43 Jul 09 17:19:29 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:29 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9163bd05-8775-496e-9336-fde228495d43" returned: 0 in 0.695s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-9163bd05-8775-496e-9336-fde228495d43" released by "delete_volume" :: held 1.641s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['b904366b-7d56-48b0-9405-ad01498a7684', 'c19407fc-b6b1-4cf4-9d34-b537d4fe1695', 'fe88f8f3-5888-4177-824e-2baac0b3d7fa', '7b15e1b2-e6a2-478c-a5b9-3b3e23034358'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:29 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:29 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-a60332c7-c38a-4e70-9edf-57b768dc58b9-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-a60332c7-c38a-4e70-9edf-57b768dc58b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Deleting offline snapshot a60332c7-c38a-4e70-9edf-57b768dc58b9 of volume ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] snapshot_file for this snap is: volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[40872e04-46cb-4566-ac90-a155130ac0f2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:30 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.640s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Deleted volume successfully. Jul 09 17:19:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e593eeb9-c86a-4b14-aea8-fdd91f56927b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-9163bd05-8775-496e-9336-fde228495d43-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:30 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:30 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:31 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.836s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef46090b-e02d-4209-a763-95d330188810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:19:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9667d4-3ec4-4df6-b7df-d412bab77be1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:31 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:31 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:32 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.839s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:32 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:32 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:32 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:32 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9 Jul 09 17:19:32 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:33 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810.a60332c7-c38a-4e70-9edf-57b768dc58b9" returned: 0 in 0.670s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-a60332c7-c38a-4e70-9edf-57b768dc58b9" released by "_delete_snapshot" :: held 3.336s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" released by "delete_snapshot" :: held 3.363s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['d95ff4f6-82cf-41a5-9c08-2130a897259a', '056555bb-a38d-4116-8bb7-f73f1771821e', 'a869e690-7e0d-4e0d-a7bf-580edbfe7884', '4681b45d-39db-4153-8e3e-6a092bd80924'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Delete snapshot completed successfully. Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-da8d24de-81c9-4336-bc5b-c2b03cf5c807 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-a60332c7-c38a-4e70-9edf-57b768dc58b9-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "cinder-541cac37-1254-40e5-9aab-6cfda7673ba8-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-541cac37-1254-40e5-9aab-6cfda7673ba8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "cinder-quobyte-541cac37-1254-40e5-9aab-6cfda7673ba8" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-quobyte-541cac37-1254-40e5-9aab-6cfda7673ba8" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06d9761-3998-493f-8c26-7fac43942816]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:34 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 Jul 09 17:19:34 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-ef46090b-e02d-4209-a763-95d330188810-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-ef46090b-e02d-4209-a763-95d330188810-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc6de9-66a8-432f-af80-b95784e36717]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:34 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:34 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8 Jul 09 17:19:34 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:34 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:34 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:35 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-541cac37-1254-40e5-9aab-6cfda7673ba8" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-quobyte-541cac37-1254-40e5-9aab-6cfda7673ba8" released by "delete_volume" :: held 1.514s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:35 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:35 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810 Jul 09 17:19:35 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Created reservations ['6093e557-c521-44ca-a839-49df6eb68701', '86bcd15e-3535-4025-8edd-f9656a3cfcc4', 'd12155e9-54b5-4007-ba9b-151f8ae16fd2', 'a4a70994-3a98-44cd-a4c3-721ce1ffc181'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:35 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:35 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "cinder-640bd073-09e9-4b39-ac9a-6d570e0af769-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:36 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef46090b-e02d-4209-a763-95d330188810" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-640bd073-09e9-4b39-ac9a-6d570e0af769-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ef46090b-e02d-4209-a763-95d330188810" released by "delete_volume" :: held 1.532s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "cinder-quobyte-640bd073-09e9-4b39-ac9a-6d570e0af769" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-quobyte-640bd073-09e9-4b39-ac9a-6d570e0af769" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['0db53476-7501-4344-b6cd-21e21882c313', 'ca79626f-26d0-4aeb-a428-3acc807e64fc', 'ba48b494-c4ad-4ea1-9629-46d9b29e511c', '478765eb-b52e-4e82-9437-0074639ae185'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065fabe-c6fb-4ba7-ab9e-3d2fe97bd148]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:36 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:36 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:36 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Deleted volume successfully. Jul 09 17:19:36 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 Jul 09 17:19:36 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9c843d65-564c-4e0b-a677-ae2cc18752f7 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-541cac37-1254-40e5-9aab-6cfda7673ba8-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:37 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Deleted volume successfully. Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1423debe-eecd-48ea-a4ca-181549bdd79f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-ef46090b-e02d-4209-a763-95d330188810-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:37 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769" returned: 0 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:37 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769 Jul 09 17:19:37 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (4a66a69c-7713-4a77-a8cd-853e89b9a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b5591-2491-473a-92a0-99d83f6b0c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b5591-2491-473a-92a0-99d83f6b0c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1841692770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b35c1-5bec-475b-a76d-a67e6436b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:37Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ffa78-7a64-44b0-8957-7ae0c59b4dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9ffa78-7a64-44b0-8957-7ae0c59b4dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493df289-1bdd-45d9-b045-624c6c6713da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493df289-1bdd-45d9-b045-624c6c6713da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253b35c1-5bec-475b-a76d-a67e6436b961', 'volume_name': 'volume-253b35c1-5bec-475b-a76d-a67e6436b961', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b177b1ed-74f2-477f-9a26-b14404d9cbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b177b1ed-74f2-477f-9a26-b14404d9cbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d67e7c0-3a8e-48bb-9b3c-fe1a46e5be53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Volume 253b35c1-5bec-475b-a76d-a67e6436b961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253b35c1-5bec-475b-a76d-a67e6436b961', 'volume_size': 1} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1841692770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b35c1-5bec-475b-a76d-a67e6436b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:37Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Creating volume 253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:37 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 1073741824 Jul 09 17:19:37 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:37 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-640bd073-09e9-4b39-ac9a-6d570e0af769" returned: 0 in 0.737s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-quobyte-640bd073-09e9-4b39-ac9a-6d570e0af769" released by "delete_volume" :: held 1.660s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:37 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Created reservations ['337e65d4-bec2-404d-8fd8-5900f15a30c6', 'a8a27ef6-93f4-4270-831f-be09c8be7f66', '2e212501-61c4-4a42-8be9-06e9f7e1bd26', '35aab657-2792-4769-b228-fd9cca9e60fc'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:38 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:38 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:38 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 1073741824" returned: 0 in 0.884s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:38 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:19:38 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:38 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.730s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Deleted volume successfully. Jul 09 17:19:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e47ff867-fff4-4878-925f-fe5f4884d879 tempest-TestServerVolumeAttachmentScenario-1690902118 None] Lock "cinder-640bd073-09e9-4b39-ac9a-6d570e0af769-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:39 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.680s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d67e7c0-3a8e-48bb-9b3c-fe1a46e5be53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253b35c1-5bec-475b-a76d-a67e6436b961', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa10adca-aa99-4190-985f-7f92d96d73e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Volume volume-253b35c1-5bec-475b-a76d-a67e6436b961 (253b35c1-5bec-475b-a76d-a67e6436b961): created successfully Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa10adca-aa99-4190-985f-7f92d96d73e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (4a66a69c-7713-4a77-a8cd-853e89b9a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-58488c4d-6297-4201-96fd-e2ea141009ed tempest-VolumesSnapshotTestJSON-1128261735 None] Created volume successfully. Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Creating offline snapshot 411bfe7d-b906-4165-98fa-cd330cdb0b16 of volume 253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf69608-7037-46c7-ab67-f46b7f548cf1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:39 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:19:39 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:40 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.817s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:40 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 1G Jul 09 17:19:40 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:41 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 1G" returned: 0 in 1.008s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253b35c1-5bec-475b-a76d-a67e6436b961 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:41 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253b35c1-5bec-475b-a76d-a67e6436b961 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:41 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:42 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-253b35c1-5bec-475b-a76d-a67e6436b961 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.780s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:42 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 is being set with open permissions: ugo+rw Jul 09 17:19:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:42 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:42 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:43 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:43 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info Jul 09 17:19:43 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:43 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info" returned: 0 in 0.714s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:43 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info is being set with open permissions: ugo+rw Jul 09 17:19:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:43 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info Jul 09 17:19:43 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:44 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.info" returned: 0 in 0.685s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.849s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-00ddf185-364f-4365-be05-d99a39e9554b tempest-VolumesSnapshotTestJSON-1128261735 None] Create snapshot completed successfully Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (2baeb001-de98-423d-a163-9512045709e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0690c399-07e8-46dc-9bb0-07808b7fd9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0690c399-07e8-46dc-9bb0-07808b7fd9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2063396033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93aeed48a2454016be20f97894e6f0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=411bfe7d-b906-4165-98fa-cd330cdb0b16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:45Z,use_quota=True,user_id='40b952256fe04b5d9eadb6f45d6d9d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff543c11-cbba-48bf-bac5-d7d1298f78f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff543c11-cbba-48bf-bac5-d7d1298f78f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b202c9f-73b3-4451-a6f4-b431eebb356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b202c9f-73b3-4451-a6f4-b431eebb356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2', 'volume_name': 'volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2', 'volume_size': 1, 'snapshot_id': '411bfe7d-b906-4165-98fa-cd330cdb0b16'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33b1f8-d50d-44cc-b16e-1bc0fe0951bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33b1f8-d50d-44cc-b16e-1bc0fe0951bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c270da-afe1-457a-b366-028090a174f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2', 'volume_size': 1, 'snapshot_id': '411bfe7d-b906-4165-98fa-cd330cdb0b16'} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating volume ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 from snapshot 411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] snapshot: 411bfe7d-b906-4165-98fa-cd330cdb0b16, volume: ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c5d6d-1954-4133-8c14-890cd380117b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:45 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:45 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:46 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.837s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-253b35c1-5bec-475b-a76d-a67e6436b961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37210b9-5575-4025-b880-7a3493f2c753]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:46 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:19:46 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:47 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.806s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:47 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:19:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:47 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 Jul 09 17:19:47 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Flow 'volume_create_manager' (3aa62b84-8cb5-41ad-b705-bef5fa37d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26535d46-33e3-49a1-9b09-30d329d7e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26535d46-33e3-49a1-9b09-30d329d7e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d27d3a2-3623-4d80-9e7b-e3aae988b777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba451ac8a464495b06387eaf58fb657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:51Z,use_quota=True,user_id='3abbeb2d7b3c4cf1a0f3a56302702235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb9f525-cefe-40af-8820-fbcf899c7e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb9f525-cefe-40af-8820-fbcf899c7e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536dca2d-903b-449d-b629-f0472c94b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536dca2d-903b-449d-b629-f0472c94b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d27d3a2-3623-4d80-9e7b-e3aae988b777', 'volume_name': 'volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bc7fa5-ecb0-4f03-86ff-0b338fa7ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bc7fa5-ecb0-4f03-86ff-0b338fa7ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea47ae-5686-49de-a49d-a5aa441dc6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:51 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Volume 9d27d3a2-3623-4d80-9e7b-e3aae988b777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777', 'volume_size': 1} Jul 09 17:19:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:52 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" returned: 0 in 4.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace3359-108a-4089-963f-ad81ef6cbfd5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:52 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:19:52 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:52 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.879s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:19:52 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Converted 1024.00 MB image at 215.32 MB/s Jul 09 17:19:52 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 is being set with open permissions: ugo+rw Jul 09 17:19:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:52 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 Jul 09 17:19:52 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:53 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" returned: 0 in 0.612s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" released by "_copy_volume_from_snapshot" :: held 7.996s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" released by "_create_volume_from_snapshot" :: held 8.027s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.048s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d27d3a2-3623-4d80-9e7b-e3aae988b777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba451ac8a464495b06387eaf58fb657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:51Z,use_quota=True,user_id='3abbeb2d7b3c4cf1a0f3a56302702235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Creating volume 9d27d3a2-3623-4d80-9e7b-e3aae988b777 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:53 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:53 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 1073741824 Jul 09 17:19:53 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c270da-afe1-457a-b366-028090a174f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2', 'volume_size': 1, 'snapshot_id': '411bfe7d-b906-4165-98fa-cd330cdb0b16'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c89f00-64d6-4fbf-8aa9-4b06e96fe288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:53 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Volume volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 (ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2): created successfully Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c89f00-64d6-4fbf-8aa9-4b06e96fe288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Flow 'volume_create_manager' (2baeb001-de98-423d-a163-9512045709e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:53 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a667a1b5-8f40-4e4d-b105-353674891767 tempest-VolumesSnapshotTestJSON-1128261735 None] Created volume successfully. Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ae54d5-2b20-4b71-8588-f2ecf25999a9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:54 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 Jul 09 17:19:54 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:54 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 1073741824" returned: 0 in 0.833s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:54 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 Jul 09 17:19:54 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:54 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:54 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2 Jul 09 17:19:54 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:55 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea47ae-5686-49de-a49d-a5aa441dc6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8940affe-b1a1-4cee-bd50-5248e175b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Volume volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 (9d27d3a2-3623-4d80-9e7b-e3aae988b777): created successfully Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8940affe-b1a1-4cee-bd50-5248e175b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Flow 'volume_create_manager' (3aa62b84-8cb5-41ad-b705-bef5fa37d759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8ea73fec-6fb8-4eee-a220-9ca23bed184d tempest-CinderUnicodeTest-162007112 None] Created volume successfully. Jul 09 17:19:55 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" returned: 0 in 0.643s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2" released by "delete_volume" :: held 1.447s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['831b04f2-5dec-4235-ac98-897e32de697b', 'acf2a2c0-4d7c-475c-92ca-a30de61a5db0', '53b4fb4d-0be5-4d98-a230-729a2b6f9bdb', 'f37261f0-9f25-4cce-b0ae-a4021bd8bd73'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:55 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:19:55 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:55 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Flow 'volume_create_manager' (45eaa132-8faa-4318-a55d-91d6202954a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ca0444-cb78-4836-8ecb-07790265419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ca0444-cb78-4836-8ecb-07790265419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614864719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a867d552-8fc1-4c91-95c9-1c377c46d595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba451ac8a464495b06387eaf58fb657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:56Z,use_quota=True,user_id='3abbeb2d7b3c4cf1a0f3a56302702235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e55379-b4ab-419a-9afe-0a767a2aac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e55379-b4ab-419a-9afe-0a767a2aac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5278aa2b-e9ed-4670-ac90-002b654a27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5278aa2b-e9ed-4670-ac90-002b654a27ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a867d552-8fc1-4c91-95c9-1c377c46d595', 'volume_name': 'volume-a867d552-8fc1-4c91-95c9-1c377c46d595', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9224b5-3fb1-44d1-802e-5f3b41c44704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9224b5-3fb1-44d1-802e-5f3b41c44704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c66ea4-810a-4192-87be-c99559ba39d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Volume a867d552-8fc1-4c91-95c9-1c377c46d595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a867d552-8fc1-4c91-95c9-1c377c46d595', 'volume_size': 1} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:19:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614864719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a867d552-8fc1-4c91-95c9-1c377c46d595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba451ac8a464495b06387eaf58fb657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:19:56Z,use_quota=True,user_id='3abbeb2d7b3c4cf1a0f3a56302702235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Creating volume a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:19:56 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:56 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 1073741824 Jul 09 17:19:56 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-411bfe7d-b906-4165-98fa-cd330cdb0b16-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-411bfe7d-b906-4165-98fa-cd330cdb0b16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:19:56 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Deleting offline snapshot 411bfe7d-b906-4165-98fa-cd330cdb0b16 of volume 253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] snapshot_file for this snap is: volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:19:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Deleted volume successfully. Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[624912d6-e48f-4242-a658-16d982fe2d7d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-75ec26fc-ec75-4537-a652-9daf7448d544 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-ea50ef63-e4ac-4b94-8d76-e8b04e51ddf2-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:56 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:56 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:56 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 1073741824" returned: 0 in 0.854s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:57 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 Jul 09 17:19:57 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:57 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.780s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-253b35c1-5bec-475b-a76d-a67e6436b961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5e780-5dc4-487c-9e7d-ae8a4b39c3f8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:57 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:19:57 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:57 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595" returned: 0 in 0.662s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=78,cinder:UPDATE=81,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c66ea4-810a-4192-87be-c99559ba39d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a867d552-8fc1-4c91-95c9-1c377c46d595', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd6a124-8ca3-4081-b27a-446ec91a67ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:19:57 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Volume volume-a867d552-8fc1-4c91-95c9-1c377c46d595 (a867d552-8fc1-4c91-95c9-1c377c46d595): created successfully Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd6a124-8ca3-4081-b27a-446ec91a67ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Flow 'volume_create_manager' (45eaa132-8faa-4318-a55d-91d6202954a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:19:57 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-40ee1f25-c9ac-4078-a278-a0841830b994 tempest-CinderUnicodeTest-162007112 None] Created volume successfully. Jul 09 17:19:57 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.748s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:58 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:58 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=75,cinder:SELECT=85,cinder:DELETE=10,cinder:INSERT=17 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Creating offline snapshot d58aa1da-0416-4fc0-adda-72bb1a0e91e3 of volume a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522430a-6824-48a0-9fca-2496b1dc2f8c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:58 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 Jul 09 17:19:58 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:58 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.751s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:58 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16 Jul 09 17:19:58 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:59 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595" returned: 0 in 0.785s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:59 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 1G Jul 09 17:19:59 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:19:59 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961.411bfe7d-b906-4165-98fa-cd330cdb0b16" returned: 0 in 0.671s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-411bfe7d-b906-4165-98fa-cd330cdb0b16" released by "_delete_snapshot" :: held 3.077s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" released by "delete_snapshot" :: held 3.108s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['e1886321-fe3f-468e-8b0b-d3e535ab2fb5', '3efa891a-bcdc-4882-bb2c-667075f0e539', '7e6f0109-a8b3-4e67-b1e7-e7a8d0eb6882', 'c4b071eb-16f3-41db-a90c-1e4035c7186d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:19:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Delete snapshot completed successfully. Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-21c41a7b-2e89-41ef-80d8-51fd262956a2 tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-411bfe7d-b906-4165-98fa-cd330cdb0b16-delete_snapshot" released by "delete_snapshot" :: held 3.303s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:19:59 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 1G" returned: 0 in 0.802s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:19:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a867d552-8fc1-4c91-95c9-1c377c46d595 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:19:59 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a867d552-8fc1-4c91-95c9-1c377c46d595 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 Jul 09 17:19:59 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:00 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:00 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-253b35c1-5bec-475b-a76d-a67e6436b961-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-253b35c1-5bec-475b-a76d-a67e6436b961-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:00 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a867d552-8fc1-4c91-95c9-1c377c46d595 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:00 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 is being set with open permissions: ugo+rw Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:00 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 Jul 09 17:20:00 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6ae86-b550-498a-be27-83f37b14d633]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:00 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:20:00 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:01 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.709s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:20:01 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3" returned: 0 in 0.665s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:01 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info Jul 09 17:20:01 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:01 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.787s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:01 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961 Jul 09 17:20:01 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:02 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info" returned: 0 in 0.677s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:02 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info is being set with open permissions: ugo+rw Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:02 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info Jul 09 17:20:02 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:02 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-253b35c1-5bec-475b-a76d-a67e6436b961" returned: 0 in 0.691s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-253b35c1-5bec-475b-a76d-a67e6436b961" released by "delete_volume" :: held 1.541s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['829d33f2-083e-4609-be4c-8f278c8b2016', 'f962ae2e-696f-4860-9799-bd8b98111b27', '4a7d3f4d-7e6e-4bbf-927d-1d091ac3de55', '5cc4eb26-b8c8-4478-9642-01f7e91a4f8c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:02 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:02 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:02 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.info" returned: 0 in 0.667s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:02 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fe1c19c6-fcaf-4280-8f5e-79de00f183b5 tempest-CinderUnicodeTest-162007112 None] Create snapshot completed successfully Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-50bb1753-298c-46ad-abcf-b70ca4b818c7-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-50bb1753-298c-46ad-abcf-b70ca4b818c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d42e37-ec3f-4b14-9c23-c24e24902b7f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:03 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.702s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Deleted volume successfully. Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e3aade95-da64-4c42-8ebc-63f60a4c871d tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-253b35c1-5bec-475b-a76d-a67e6436b961-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:03 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 Jul 09 17:20:03 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-d58aa1da-0416-4fc0-adda-72bb1a0e91e3-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-d58aa1da-0416-4fc0-adda-72bb1a0e91e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-quobyte-d58aa1da-0416-4fc0-adda-72bb1a0e91e3" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-d58aa1da-0416-4fc0-adda-72bb1a0e91e3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Deleting offline snapshot d58aa1da-0416-4fc0-adda-72bb1a0e91e3 of volume a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] snapshot_file for this snap is: volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be672b-b43e-4e87-a249-f657492f1b73]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:03 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 Jul 09 17:20:03 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:03 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7" returned: 0 in 0.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:03 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7 Jul 09 17:20:03 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:04 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a867d552-8fc1-4c91-95c9-1c377c46d595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6223621f-91e1-4dde-8fbf-621900234fa4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:04 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-50bb1753-298c-46ad-abcf-b70ca4b818c7" returned: 0 in 0.654s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-quobyte-50bb1753-298c-46ad-abcf-b70ca4b818c7" released by "delete_volume" :: held 1.469s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Created reservations ['b52c7a11-58f6-44a2-b717-f061cb12c4d8', '485ed378-3412-4de8-ae9e-998fdb75e9aa', 'fcfc06ec-6b24-4257-b1f9-a0b3a02ba7af', 'c1f25dfa-87d6-45ff-b7df-3137367b5a3f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:04 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 Jul 09 17:20:04 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:04 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:04 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:05 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595" returned: 0 in 0.826s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:05 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.645s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:05 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:05 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 Jul 09 17:20:05 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Deleted volume successfully. Jul 09 17:20:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-32d76d83-85d6-4e21-b0f3-2dbb93f54e7f tempest-VolumesSnapshotTestJSON-1128261735 None] Lock "cinder-50bb1753-298c-46ad-abcf-b70ca4b818c7-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:06 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:06 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3 Jul 09 17:20:06 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:06 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595.d58aa1da-0416-4fc0-adda-72bb1a0e91e3" returned: 0 in 0.663s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-d58aa1da-0416-4fc0-adda-72bb1a0e91e3" released by "_delete_snapshot" :: held 3.167s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" released by "delete_snapshot" :: held 3.188s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Created reservations ['6f38eafa-9fb8-4002-aa52-e9a83d0b8e50', 'f68e40f5-6130-45af-80b5-b984fc069afa', '85e7d80f-6c15-4461-809c-64ccbbf14391', 'fb87fcf7-a6d1-4ff7-83b0-ef41b8f064b0'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Delete snapshot completed successfully. Jul 09 17:20:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-27a0742f-1b6a-4f0e-8217-3797c94a2937 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-d58aa1da-0416-4fc0-adda-72bb1a0e91e3-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-a867d552-8fc1-4c91-95c9-1c377c46d595-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-a867d552-8fc1-4c91-95c9-1c377c46d595-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8119b4-0d65-418e-bfae-c0733c9e1335]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:08 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 Jul 09 17:20:08 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:08 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595" returned: 0 in 0.850s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:08 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595 Jul 09 17:20:08 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:09 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a867d552-8fc1-4c91-95c9-1c377c46d595" returned: 0 in 0.717s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-a867d552-8fc1-4c91-95c9-1c377c46d595" released by "delete_volume" :: held 1.632s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Created reservations ['2513a065-679f-42a9-a3b1-ed6e64e5d797', 'aff39d2c-94ea-4547-828c-8468328455ed', '3a6fb56b-ff28-4b4a-a006-4248a91d10ff', '7432292c-dcd8-4d11-90b1-b1c420539962'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:09 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:09 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-9d27d3a2-3623-4d80-9e7b-e3aae988b777-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-9d27d3a2-3623-4d80-9e7b-e3aae988b777-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "cinder-quobyte-9d27d3a2-3623-4d80-9e7b-e3aae988b777" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-9d27d3a2-3623-4d80-9e7b-e3aae988b777" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85e3f1-5adb-4336-8334-ddff79d62191]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:10 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 Jul 09 17:20:10 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:10 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:10 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Deleted volume successfully. Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b58312c3-400f-428a-bd17-f8ad9bb77248 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-a867d552-8fc1-4c91-95c9-1c377c46d595-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Flow 'volume_create_manager' (d2fbe9e7-bcec-49b0-ab46-58d480db7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e6c8d-98d5-418c-b2a1-546bf9d6250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3e6c8d-98d5-418c-b2a1-546bf9d6250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1601939323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd24f3-792c-40d3-8112-6b34490d5e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad98b98e0024b09a5a96523a8d1a46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:20:11Z,use_quota=True,user_id='c3d9b5efc95c44388748e6e0f3f6c093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62974876-dc28-4730-bd9f-9b27b91cd01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62974876-dc28-4730-bd9f-9b27b91cd01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f84b6c6-64b2-4609-8def-1053f182d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f84b6c6-64b2-4609-8def-1053f182d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fd24f3-792c-40d3-8112-6b34490d5e6f', 'volume_name': 'volume-04fd24f3-792c-40d3-8112-6b34490d5e6f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03bebbc-77fa-4093-9648-3496afd22cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03bebbc-77fa-4093-9648-3496afd22cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8e5657-380e-43a9-96af-30cf8c2deddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Volume 04fd24f3-792c-40d3-8112-6b34490d5e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fd24f3-792c-40d3-8112-6b34490d5e6f', 'volume_size': 1} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1601939323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fd24f3-792c-40d3-8112-6b34490d5e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad98b98e0024b09a5a96523a8d1a46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:20:11Z,use_quota=True,user_id='c3d9b5efc95c44388748e6e0f3f6c093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Creating volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:20:11 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:11 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f 1073741824 Jul 09 17:20:11 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:11 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777" returned: 0 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:11 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777 Jul 09 17:20:11 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:11 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9d27d3a2-3623-4d80-9e7b-e3aae988b777" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-quobyte-9d27d3a2-3623-4d80-9e7b-e3aae988b777" released by "delete_volume" :: held 1.625s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:11 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f 1073741824" returned: 0 in 0.846s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Created reservations ['27579920-cc1a-4d25-9fbf-f36475033eab', '54765d4f-e738-417e-aded-0b967c8bf2b7', '95b06390-940b-4aa1-96c5-5cf5c3908474', '1b9ccbef-5e96-4b13-901c-93099d94559f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:11 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f Jul 09 17:20:11 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:11 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:11 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:12 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f" returned: 0 in 0.700s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8e5657-380e-43a9-96af-30cf8c2deddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fd24f3-792c-40d3-8112-6b34490d5e6f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea8b237-d24a-4c39-88a2-e7bc87b46ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Volume volume-04fd24f3-792c-40d3-8112-6b34490d5e6f (04fd24f3-792c-40d3-8112-6b34490d5e6f): created successfully Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea8b237-d24a-4c39-88a2-e7bc87b46ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Flow 'volume_create_manager' (d2fbe9e7-bcec-49b0-ab46-58d480db7804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-42def8d8-ffb9-4bac-b1d7-2cfd30366773 tempest-VolumesSnapshotListTestJSON-214498408 None] Created volume successfully. Jul 09 17:20:12 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.751s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Deleted volume successfully. Jul 09 17:20:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d06a3b87-ab0a-4dae-974a-7d0a2fd0f9b0 tempest-CinderUnicodeTest-162007112 None] Lock "cinder-9d27d3a2-3623-4d80-9e7b-e3aae988b777-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Creating offline snapshot 30796299-8224-4531-b6cd-36132d25adea of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:20:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd434b-ac16-4a3e-8d5d-62e30966f57e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:13 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f Jul 09 17:20:13 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:14 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f" returned: 0 in 0.794s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:14 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea 1G Jul 09 17:20:14 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:14 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea 1G" returned: 0 in 0.813s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:14 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:14 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:15 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:15 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea is being set with open permissions: ugo+rw Jul 09 17:20:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:15 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:15 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:16 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.678s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:16 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info Jul 09 17:20:16 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:16 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info" returned: 0 in 0.663s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:16 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info is being set with open permissions: ugo+rw Jul 09 17:20:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:17 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info Jul 09 17:20:17 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:17 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.info" returned: 0 in 0.704s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.493s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-717ece52-cf42-410e-9a7b-4bafb5f53981 tempest-VolumesSnapshotListTestJSON-214498408 None] Create snapshot completed successfully Jul 09 17:20:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Creating offline snapshot f1b8a437-6442-48eb-a85c-e2bfaced24b4 of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:20:18 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[412dc205-7bbb-4001-a61c-96550fdfc9d7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:18 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:18 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:19 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:19 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 1G Jul 09 17:20:19 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:20 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 1G" returned: 0 in 0.927s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:20 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:20 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:21 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.794s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:21 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 is being set with open permissions: ugo+rw Jul 09 17:20:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:21 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:21 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:21 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.679s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1ba44d56-0a29-466f-8533-182c896f3995 tempest-VolumesSnapshotListTestJSON-214498408 None] Create snapshot completed successfully Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Creating offline snapshot 775f6589-5bee-4560-862d-b389c2804883 of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d51e42-b366-480e-bfcd-a5753881b1d3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:23 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:23 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:23 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.850s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:23 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 1G Jul 09 17:20:23 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:24 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 1G" returned: 0 in 1.035s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:25 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 Jul 09 17:20:25 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:25 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:25 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 is being set with open permissions: ugo+rw Jul 09 17:20:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:25 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 Jul 09 17:20:25 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:26 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.474s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:26 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-24028ec7-1cdb-4ab5-8fd3-d7243e1f8155 tempest-VolumesSnapshotListTestJSON-214498408 None] Create snapshot completed successfully Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-775f6589-5bee-4560-862d-b389c2804883-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-775f6589-5bee-4560-862d-b389c2804883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-775f6589-5bee-4560-862d-b389c2804883" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-775f6589-5bee-4560-862d-b389c2804883" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Deleting offline snapshot 775f6589-5bee-4560-862d-b389c2804883 of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] snapshot_file for this snap is: volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc8601-5e38-4b39-96e0-9e9c01e0ae92]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:28 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 Jul 09 17:20:28 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:29 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883" returned: 0 in 0.892s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e850994-6ce2-4d66-bc28-798d8efbb00c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:29 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:29 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:29 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.780s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:29 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 Jul 09 17:20:29 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:30 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883" returned: 0 in 0.920s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:30 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883 Jul 09 17:20:30 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:31 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.775f6589-5bee-4560-862d-b389c2804883" returned: 0 in 0.695s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-775f6589-5bee-4560-862d-b389c2804883" released by "_delete_snapshot" :: held 3.405s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" released by "delete_snapshot" :: held 3.436s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Created reservations ['4082ebe3-07e7-43f3-8533-8f5cfde143cb', '176e3fa3-d2c7-4c6e-8ca2-b3def28d5a25', '71ca1359-caeb-4bf2-a4e8-b361d503aa63', '501abaf0-7c7d-419a-89fc-a75ce77d86ae'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Delete snapshot completed successfully. Jul 09 17:20:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b2e37b5a-74e2-460e-96c2-c9b09c856483 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-775f6589-5bee-4560-862d-b389c2804883-delete_snapshot" released by "delete_snapshot" :: held 3.588s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-f1b8a437-6442-48eb-a85c-e2bfaced24b4-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-f1b8a437-6442-48eb-a85c-e2bfaced24b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-f1b8a437-6442-48eb-a85c-e2bfaced24b4" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-f1b8a437-6442-48eb-a85c-e2bfaced24b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Deleting offline snapshot f1b8a437-6442-48eb-a85c-e2bfaced24b4 of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] snapshot_file for this snap is: volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f54f809-70c8-4b12-92b1-5f4ae8a24fee]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:32 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:32 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:33 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a718fc7-9f18-4a27-86a5-ba457acdcc4a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:33 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:33 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:34 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:34 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:34 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:35 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.917s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:35 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4 Jul 09 17:20:35 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:35 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.f1b8a437-6442-48eb-a85c-e2bfaced24b4" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-f1b8a437-6442-48eb-a85c-e2bfaced24b4" released by "_delete_snapshot" :: held 3.328s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" released by "delete_snapshot" :: held 3.355s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Created reservations ['957dfc00-1071-402e-9b5f-d5ad6c5fd7f5', '90f75881-8790-4b67-8c5c-71a1d48f2c5b', '7431ef30-2eeb-49eb-98db-d8e481f9029f', '1e30228e-4747-46c4-ab78-28c9f304c175'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Delete snapshot completed successfully. Jul 09 17:20:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2c9db8fc-221e-40dd-839c-b54b56877b33 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-f1b8a437-6442-48eb-a85c-e2bfaced24b4-delete_snapshot" released by "delete_snapshot" :: held 3.524s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-30796299-8224-4531-b6cd-36132d25adea-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-30796299-8224-4531-b6cd-36132d25adea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-30796299-8224-4531-b6cd-36132d25adea" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-30796299-8224-4531-b6cd-36132d25adea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Deleting offline snapshot 30796299-8224-4531-b6cd-36132d25adea of volume 04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] snapshot_file for this snap is: volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[61579df3-6bcd-4c5d-a2d2-0e92a9eea0f6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:36 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:36 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:37 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.895s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fd24f3-792c-40d3-8112-6b34490d5e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[98583825-6c02-43f2-9298-7a3446f40116]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:37 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f Jul 09 17:20:37 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:38 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f" returned: 0 in 0.783s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:38 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:38 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Flow 'volume_create_manager' (7abb204e-2415-4929-b15b-63adf462b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347b709c-3d1e-4270-ac8a-536e34f8d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347b709c-3d1e-4270-ac8a-536e34f8d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-291145845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1395ce-30a1-4425-8400-bc97082cc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51c625b9703450dbc0e14cf92e5f4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:20:39Z,use_quota=True,user_id='034ba182fd2a47b683e5fb6e5f9b90aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826659b-6f72-402b-be50-3c3d13a52211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826659b-6f72-402b-be50-3c3d13a52211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1465fc63-71b0-4648-b8d7-b81d41882133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1465fc63-71b0-4648-b8d7-b81d41882133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1395ce-30a1-4425-8400-bc97082cc353', 'volume_name': 'volume-8f1395ce-30a1-4425-8400-bc97082cc353', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70adce6d-a4d6-4532-a0a2-22842873fe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70adce6d-a4d6-4532-a0a2-22842873fe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6d9f0f-030b-4520-b8b7-a9ef6352446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:38 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Volume 8f1395ce-30a1-4425-8400-bc97082cc353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1395ce-30a1-4425-8400-bc97082cc353', 'volume_size': 1} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-291145845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1395ce-30a1-4425-8400-bc97082cc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51c625b9703450dbc0e14cf92e5f4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:20:39Z,use_quota=True,user_id='034ba182fd2a47b683e5fb6e5f9b90aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Creating volume 8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:20:38 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:20:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:38 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 1073741824 Jul 09 17:20:38 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:39 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.746s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:39 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea Jul 09 17:20:39 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:39 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 1073741824" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:39 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:20:39 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:39 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f.30796299-8224-4531-b6cd-36132d25adea" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-30796299-8224-4531-b6cd-36132d25adea" released by "_delete_snapshot" :: held 3.251s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" released by "delete_snapshot" :: held 3.274s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Created reservations ['111d8a36-583a-43ab-b7eb-aa3c268adeee', '3317dbc1-738d-4377-83ca-a36efc551565', '8d75b004-4175-4e14-9b8e-5850c422de9e', '880d39a7-6e7f-4956-85e9-53be425b3839'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Delete snapshot completed successfully. Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-47e918a0-d2de-4b4f-b0fc-b4b4c5aa7248 tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-30796299-8224-4531-b6cd-36132d25adea-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:40 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.661s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6d9f0f-030b-4520-b8b7-a9ef6352446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1395ce-30a1-4425-8400-bc97082cc353', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ec768c-c5a2-4c95-8cba-84594a157ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Volume volume-8f1395ce-30a1-4425-8400-bc97082cc353 (8f1395ce-30a1-4425-8400-bc97082cc353): created successfully Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ec768c-c5a2-4c95-8cba-84594a157ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Flow 'volume_create_manager' (7abb204e-2415-4929-b15b-63adf462b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f85e95f9-82ea-43d0-900a-3e69d9b299e9 tempest-SnapshotDependencyTests-1155957589 None] Created volume successfully. Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-04fd24f3-792c-40d3-8112-6b34490d5e6f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-04fd24f3-792c-40d3-8112-6b34490d5e6f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbcec92-c403-402d-b197-1b401d90d07a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Creating offline snapshot 76654901-cb7b-4419-b20b-55af344451d2 of volume 8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:20:41 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f Jul 09 17:20:41 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c698e39-70ee-4a6d-adfd-9eab5a134b8d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:41 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:20:41 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:41 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f" returned: 0 in 0.768s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:41 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f Jul 09 17:20:41 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:41 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.761s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:41 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 1G Jul 09 17:20:41 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:42 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-04fd24f3-792c-40d3-8112-6b34490d5e6f" returned: 0 in 0.679s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-quobyte-04fd24f3-792c-40d3-8112-6b34490d5e6f" released by "delete_volume" :: held 1.512s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Created reservations ['5d75d6a3-acd6-4335-bced-e3849d4fff74', '1548364a-a80d-4418-963a-b58f8db47433', 'f1891c90-a6a8-4e82-8e66-62cbf6e65bad', '95658c82-a1ae-4bfd-8643-7d26321ad5df'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:42 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:20:42 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:42 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 1G" returned: 0 in 0.840s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1395ce-30a1-4425-8400-bc97082cc353 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:42 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1395ce-30a1-4425-8400-bc97082cc353 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:42 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:43 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.742s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:43 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:20:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Deleted volume successfully. Jul 09 17:20:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61e0414e-a91b-43f2-8c92-f7c96b7804ca tempest-VolumesSnapshotListTestJSON-214498408 None] Lock "cinder-04fd24f3-792c-40d3-8112-6b34490d5e6f-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:43 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1395ce-30a1-4425-8400-bc97082cc353 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:43 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 is being set with open permissions: ugo+rw Jul 09 17:20:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:43 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:43 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:44 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.653s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:44 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info Jul 09 17:20:44 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:44 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info" returned: 0 in 0.678s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:44 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info is being set with open permissions: ugo+rw Jul 09 17:20:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:44 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info Jul 09 17:20:44 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:45 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.info" returned: 0 in 0.634s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6b060153-4bbd-4bcc-94f0-a0e7f8ff80f9 tempest-SnapshotDependencyTests-1155957589 None] Create snapshot completed successfully Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Flow 'volume_create_manager' (95f8648e-2eec-4fb3-8b6e-345471ade55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d99e8a-abfc-4efc-a61e-e9dc12ec6f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d99e8a-abfc-4efc-a61e-e9dc12ec6f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74390cd7-2569-47ad-9722-97745fda00d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51c625b9703450dbc0e14cf92e5f4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76654901-cb7b-4419-b20b-55af344451d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:20:47Z,use_quota=True,user_id='034ba182fd2a47b683e5fb6e5f9b90aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cb102f-a305-4bf2-ba4e-1ed5934a7664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cb102f-a305-4bf2-ba4e-1ed5934a7664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7079bc74-f3e9-43c7-b182-72c1a4be167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7079bc74-f3e9-43c7-b182-72c1a4be167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74390cd7-2569-47ad-9722-97745fda00d5', 'volume_name': 'volume-74390cd7-2569-47ad-9722-97745fda00d5', 'volume_size': 1, 'snapshot_id': '76654901-cb7b-4419-b20b-55af344451d2'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d657937d-08a7-4261-a4e4-205ae272775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d657937d-08a7-4261-a4e4-205ae272775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2e6646-9890-46fc-8f28-84869106c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Volume 74390cd7-2569-47ad-9722-97745fda00d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74390cd7-2569-47ad-9722-97745fda00d5', 'volume_size': 1, 'snapshot_id': '76654901-cb7b-4419-b20b-55af344451d2'} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2-74390cd7-2569-47ad-9722-97745fda00d5" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2-74390cd7-2569-47ad-9722-97745fda00d5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Creating volume 74390cd7-2569-47ad-9722-97745fda00d5 from snapshot 76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] snapshot: 76654901-cb7b-4419-b20b-55af344451d2, volume: 74390cd7-2569-47ad-9722-97745fda00d5, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d473958-672b-4a72-8c1f-32304dba602b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:47 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:47 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:48 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f1395ce-30a1-4425-8400-bc97082cc353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[50576b72-6611-4d6e-9aac-848cabee7ba7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:48 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:20:48 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:48 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:20:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:48 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 Jul 09 17:20:48 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:54 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5" returned: 0 in 5.220s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38501d2-dd8f-4823-8aa1-b56fbc4f6888]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:54 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:20:54 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:55 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 1.004s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:20:55 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Converted 1024.00 MB image at 196.10 MB/s Jul 09 17:20:55 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 is being set with open permissions: ugo+rw Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:55 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 Jul 09 17:20:55 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:55 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5" returned: 0 in 0.697s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" released by "_copy_volume_from_snapshot" :: held 8.637s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2-74390cd7-2569-47ad-9722-97745fda00d5" released by "_create_volume_from_snapshot" :: held 8.674s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.698s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2e6646-9890-46fc-8f28-84869106c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74390cd7-2569-47ad-9722-97745fda00d5', 'volume_size': 1, 'snapshot_id': '76654901-cb7b-4419-b20b-55af344451d2'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc027be7-c545-41a3-bd41-f3dc7ca021e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:20:55 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Volume volume-74390cd7-2569-47ad-9722-97745fda00d5 (74390cd7-2569-47ad-9722-97745fda00d5): created successfully Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc027be7-c545-41a3-bd41-f3dc7ca021e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:20:55 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Flow 'volume_create_manager' (95f8648e-2eec-4fb3-8b6e-345471ade55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:20:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-880a4bfb-9e7e-4fcb-b4b0-ab1dfdf7887b tempest-SnapshotDependencyTests-1155957589 None] Created volume successfully. Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-76654901-cb7b-4419-b20b-55af344451d2-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-76654901-cb7b-4419-b20b-55af344451d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Deleting offline snapshot 76654901-cb7b-4419-b20b-55af344451d2 of volume 8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] snapshot_file for this snap is: volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b85f83-3bcd-448b-af92-33c6d464e366]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:57 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:57 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:57 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f1395ce-30a1-4425-8400-bc97082cc353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197e1e8-3b06-418d-a9f0-86cfaea415df]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:20:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:58 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:20:58 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:58 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.844s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:58 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:58 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:20:59 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=72,cinder:INSERT=27,cinder:UPDATE=71,cinder:DELETE=8 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:20:59 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=95,cinder:SELECT=73,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:20:59 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 09 17:20:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.863s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:20:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:20:59 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2 Jul 09 17:20:59 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:00 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353.76654901-cb7b-4419-b20b-55af344451d2" returned: 0 in 0.651s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-76654901-cb7b-4419-b20b-55af344451d2" released by "_delete_snapshot" :: held 3.335s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" released by "delete_snapshot" :: held 3.362s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Created reservations ['4f4f1907-caae-4e3e-9b22-3aad36088316', 'be4a15d0-98d8-4ad7-92cc-77768c651df2', 'ba3c55c2-2a04-453d-af9e-420462392c5a', '7dc2303a-da48-40b8-8e0c-65bdc0e98ab4'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:00 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:21:00 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Delete snapshot completed successfully. Jul 09 17:21:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d0cab37-043e-4ea6-8db0-203400f7e693 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-76654901-cb7b-4419-b20b-55af344451d2-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:01 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-8f1395ce-30a1-4425-8400-bc97082cc353-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-8f1395ce-30a1-4425-8400-bc97082cc353-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[066cddcf-efd3-4adb-8115-b752763d65e3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:21:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:01 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:21:01 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:02 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.789s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:02 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353 Jul 09 17:21:02 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:03 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8f1395ce-30a1-4425-8400-bc97082cc353" returned: 0 in 0.852s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-8f1395ce-30a1-4425-8400-bc97082cc353" released by "delete_volume" :: held 1.724s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Created reservations ['89e20475-81af-4be8-9911-c73c89f97d02', '76948813-940d-4dee-a5a1-fee92c98637c', '4ffd07a7-e83f-4593-a8ff-a0a564ecb751', '34796b41-c447-4653-8809-d8a2c0ab065b'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:03 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:21:03 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-74390cd7-2569-47ad-9722-97745fda00d5-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-74390cd7-2569-47ad-9722-97745fda00d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca94bd-dee9-4cd1-aa0e-8b7398bd911d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:03 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 Jul 09 17:21:03 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:03 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.726s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:21:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Deleted volume successfully. Jul 09 17:21:04 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-fa5e82bc-bbae-48df-8d7f-22d1b9d24133 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-8f1395ce-30a1-4425-8400-bc97082cc353-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:04 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:04 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5 Jul 09 17:21:04 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:05 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-74390cd7-2569-47ad-9722-97745fda00d5" returned: 0 in 0.693s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-quobyte-74390cd7-2569-47ad-9722-97745fda00d5" released by "delete_volume" :: held 1.557s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Created reservations ['5b5975a2-e429-4802-a997-6ca7f2ed3c7e', '4bc39d90-afd7-45fd-9f42-eb8a73bf6175', '12304ab8-e8ec-4363-a6a5-a1c2cd442db4', '17119ab6-1dbc-4326-990c-20747dc91aa9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:05 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:21:05 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:06 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.677s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:06 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:21:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Deleted volume successfully. Jul 09 17:21:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b90cafb1-a32e-4b50-9314-f3c809bb3875 tempest-SnapshotDependencyTests-1155957589 None] Lock "cinder-74390cd7-2569-47ad-9722-97745fda00d5-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Flow 'volume_create_manager' (f0f3259e-322a-48d9-81c9-e030ace0d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7749b219-395f-4d5a-bf84-de700688babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7749b219-395f-4d5a-bf84-de700688babd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1897350001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a645a322-1ef7-4fdf-bd42-c015e8dd8e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15866dce2c2642dc868ee9546d952080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:21:10Z,use_quota=True,user_id='6d849cbd8a834e12a03abfda9a8a41a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e3e107-3d1f-411b-bf49-f9857e161a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e3e107-3d1f-411b-bf49-f9857e161a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000ff1ca-84f1-4695-8c69-b86dccab7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000ff1ca-84f1-4695-8c69-b86dccab7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a645a322-1ef7-4fdf-bd42-c015e8dd8e1c', 'volume_name': 'volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be3f192-ab42-4dbe-8628-c69ecc474317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be3f192-ab42-4dbe-8628-c69ecc474317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb2100f-feb6-4765-a285-5450668ebc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Volume a645a322-1ef7-4fdf-bd42-c015e8dd8e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c', 'volume_size': 1} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1897350001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a645a322-1ef7-4fdf-bd42-c015e8dd8e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15866dce2c2642dc868ee9546d952080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:21:10Z,use_quota=True,user_id='6d849cbd8a834e12a03abfda9a8a41a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Creating volume a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:21:10 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:21:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:10 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c 1073741824 Jul 09 17:21:10 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:11 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c 1073741824" returned: 0 in 1.025s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:11 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:21:11 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:12 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.742s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb2100f-feb6-4765-a285-5450668ebc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbca676-4a59-4c99-81d0-18a9ad6713c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:21:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Volume volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c (a645a322-1ef7-4fdf-bd42-c015e8dd8e1c): created successfully Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbca676-4a59-4c99-81d0-18a9ad6713c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:21:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Flow 'volume_create_manager' (f0f3259e-322a-48d9-81c9-e030ace0d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:21:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d8981f3f-9bca-4a05-a626-e185c36cbfa0 tempest-TestStampPattern-1288890416 None] Created volume successfully. Jul 09 17:21:22 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:21:22 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:21:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:21:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:21:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13e51e-877c-46c2-bf7f-591de5b5c9de]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:21:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:21:51 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:21:51 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:21:51 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 09 17:21:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.774s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:21:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:21:51 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f423f2-6259-4951-8899-71fe7b07c3fc', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:21:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-8b8ed739-49bc-47f1-b605-1af2acf91eb8 req-9e4101f1-2cd9-4735-a986-6c50afecc957 tempest-TestStampPattern-1288890416 None] attachment_update completed successfully. Jul 09 17:21:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-60cad523-bf32-48e8-b131-1436ef44578d req-c02fda5a-0d49-4e99-9aa4-8a6fad244d74 tempest-TestStampPattern-1288890416 None] Terminate volume connection completed successfully. Jul 09 17:21:59 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-60cad523-bf32-48e8-b131-1436ef44578d req-c02fda5a-0d49-4e99-9aa4-8a6fad244d74 tempest-TestStampPattern-1288890416 None] Deleting attachment f9f423f2-6259-4951-8899-71fe7b07c3fc. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:22:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:00 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:22:00 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:01 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.608s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Creating offline snapshot 92d3949e-762b-4c9a-90a6-f0f16975e6e2 of volume a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a076c-a321-486f-b8d3-f8504c538d54]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:22:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:01 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:22:01 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:02 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:02 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 1G Jul 09 17:22:02 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:03 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 1G" returned: 0 in 0.776s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:03 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:22:03 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:04 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:04 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 is being set with open permissions: ugo+rw Jul 09 17:22:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:04 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:22:04 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:04 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.620s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:04 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info Jul 09 17:22:04 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:05 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info" returned: 0 in 0.628s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:05 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info is being set with open permissions: ugo+rw Jul 09 17:22:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:05 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info Jul 09 17:22:05 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:05 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.info" returned: 0 in 0.605s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:22:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6cc0726c-cd1c-4924-bd95-bce0d0b7c219 tempest-TestStampPattern-1288890416 None] Create snapshot completed successfully Jul 09 17:22:14 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:22:15 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Flow 'volume_create_manager' (b62a7bbf-a02b-4e2a-9be1-bcd5b1b90080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a86e5a-e42a-486c-9095-dd7e2b09e464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a86e5a-e42a-486c-9095-dd7e2b09e464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-155784067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9d426e-8901-40c0-bf05-d29d81f3e31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15866dce2c2642dc868ee9546d952080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92d3949e-762b-4c9a-90a6-f0f16975e6e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:22:17Z,use_quota=True,user_id='6d849cbd8a834e12a03abfda9a8a41a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814016f7-81ef-424d-9181-3db31ce832d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814016f7-81ef-424d-9181-3db31ce832d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878911ef-6a5a-47da-993c-822f81ac9957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878911ef-6a5a-47da-993c-822f81ac9957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce9d426e-8901-40c0-bf05-d29d81f3e31c', 'volume_name': 'volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c', 'volume_size': 1, 'snapshot_id': '92d3949e-762b-4c9a-90a6-f0f16975e6e2'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f814df85-100c-4d80-8f39-08498f856717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f814df85-100c-4d80-8f39-08498f856717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be22b771-6760-44f3-b13e-b0b4077c2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Volume ce9d426e-8901-40c0-bf05-d29d81f3e31c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c', 'volume_size': 1, 'snapshot_id': '92d3949e-762b-4c9a-90a6-f0f16975e6e2'} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2-ce9d426e-8901-40c0-bf05-d29d81f3e31c" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2-ce9d426e-8901-40c0-bf05-d29d81f3e31c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Creating volume ce9d426e-8901-40c0-bf05-d29d81f3e31c from snapshot 92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] snapshot: 92d3949e-762b-4c9a-90a6-f0f16975e6e2, volume: ce9d426e-8901-40c0-bf05-d29d81f3e31c, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c591ba0-8d66-4a47-b926-ff25fd420601]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:22:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:16 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:22:16 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:17 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f584e725-e4bb-4a64-a08c-aec7a2fda817]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:22:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:17 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:22:17 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:18 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.867s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:18 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:22:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:18 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c Jul 09 17:22:18 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:23 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c" returned: 0 in 4.875s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:23 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2aa56-0615-448f-839d-3f0ca00331af]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:22:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:23 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:22:23 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:24 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 1.076s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:24 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:22:24 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Converted 1024.00 MB image at 209.99 MB/s Jul 09 17:22:24 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c is being set with open permissions: ugo+rw Jul 09 17:22:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:22:24 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c Jul 09 17:22:24 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:22:25 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" released by "_copy_volume_from_snapshot" :: held 8.501s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2-ce9d426e-8901-40c0-bf05-d29d81f3e31c" released by "_create_volume_from_snapshot" :: held 8.537s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.554s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be22b771-6760-44f3-b13e-b0b4077c2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c', 'volume_size': 1, 'snapshot_id': '92d3949e-762b-4c9a-90a6-f0f16975e6e2'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f31b11-fff3-4c97-ac78-83b169037723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:22:25 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Volume volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c (ce9d426e-8901-40c0-bf05-d29d81f3e31c): created successfully Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f31b11-fff3-4c97-ac78-83b169037723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:22:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Flow 'volume_create_manager' (b62a7bbf-a02b-4e2a-9be1-bcd5b1b90080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:22:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-af564823-27d9-4f67-b82c-dacc1297aba5 tempest-TestStampPattern-1288890416 None] Created volume successfully. Jul 09 17:22:35 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:22:35 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:23:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:00 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:23:00 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:01 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.651s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:23:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:23:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:23:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:23:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:23:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:23:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[013722ac-23b0-4eb5-a1c2-fba61d2f1734]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:23:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:12 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c Jul 09 17:23:12 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:13 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c" returned: 0 in 0.757s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:23:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f', 'name': 'volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73e30aa4-90e4-43d2-8a73-097957cfa474', 'enforce_multipath': True} {{(pid=86876) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 17:23:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-7bf52def-d0a9-4b40-9845-730b397d2c49 req-ca32b677-fa4e-4318-a435-47ae33b1ecc4 tempest-TestStampPattern-1288890416 None] attachment_update completed successfully. Jul 09 17:23:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [req-9c24211b-b29b-4fb3-86dd-d0965fcb239a req-955da336-6303-4934-9b9d-71831cf90d40 tempest-TestStampPattern-1288890416 None] Terminate volume connection completed successfully. Jul 09 17:23:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [req-9c24211b-b29b-4fb3-86dd-d0965fcb239a req-955da336-6303-4934-9b9d-71831cf90d40 tempest-TestStampPattern-1288890416 None] Deleting attachment 73e30aa4-90e4-43d2-8a73-097957cfa474. {{(pid=86876) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-ce9d426e-8901-40c0-bf05-d29d81f3e31c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "cinder-ce9d426e-8901-40c0-bf05-d29d81f3e31c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ab7f9-bb42-4a43-becc-155aa04370fa]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:23:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:30 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c Jul 09 17:23:30 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:31 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:31 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c Jul 09 17:23:31 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:31 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ce9d426e-8901-40c0-bf05-d29d81f3e31c" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-ce9d426e-8901-40c0-bf05-d29d81f3e31c" released by "delete_volume" :: held 1.412s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Created reservations ['c81339eb-cfeb-4213-bd9f-b827730fd878', 'c8303582-7ba7-4002-865b-eb384f156b17', 'd3c793f8-85ef-4ff0-adf9-38b15ee8be2e', 'd4dc3af2-e2be-41cf-b6b2-e0bafd6d6c83'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:23:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:31 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:23:31 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:32 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.641s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:23:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Deleted volume successfully. Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-c35132b7-3650-4cd9-bc68-833baa41a2ea tempest-TestStampPattern-1288890416 None] Lock "cinder-ce9d426e-8901-40c0-bf05-d29d81f3e31c-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-92d3949e-762b-4c9a-90a6-f0f16975e6e2-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-92d3949e-762b-4c9a-90a6-f0f16975e6e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Deleting offline snapshot 92d3949e-762b-4c9a-90a6-f0f16975e6e2 of volume a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] snapshot_file for this snap is: volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0395f9e-44eb-4df6-96d5-0b4557cac791]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:23:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:32 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:23:32 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:33 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:23:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90cd7d8-348a-40b3-ab68-03e55a8a0e66]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:23:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:33 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:23:33 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:34 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:34 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:23:34 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:35 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.697s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:35 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2 Jul 09 17:23:35 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:35 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c.92d3949e-762b-4c9a-90a6-f0f16975e6e2" returned: 0 in 0.624s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-92d3949e-762b-4c9a-90a6-f0f16975e6e2" released by "_delete_snapshot" :: held 2.846s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" released by "delete_snapshot" :: held 2.869s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Created reservations ['1e2ff8f3-b400-4383-b30c-884a12a59621', 'fa0ee329-fe58-4481-9c1d-91c8bc5e5860', '94dbfc05-1b63-4861-9b9e-a949bba71a71', '89ebfcc9-51ec-471c-a8de-e288a7aaed5a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:23:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Delete snapshot completed successfully. Jul 09 17:23:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-dd52bd8f-050a-4e65-8f75-9acc2ed58362 tempest-TestStampPattern-1288890416 None] Lock "cinder-92d3949e-762b-4c9a-90a6-f0f16975e6e2-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "cinder-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Acquiring lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[737cb30a-7177-48d4-800d-b60514431a60]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:44 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:23:44 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:44 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.786s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:44 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c Jul 09 17:23:44 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:45 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" returned: 0 in 0.645s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "cinder-quobyte-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c" released by "delete_volume" :: held 1.485s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Created reservations ['13de7cd5-1620-470e-b83e-ded89c2c35fe', '061a0e01-81a2-40bd-bae1-9f959dc5ef17', 'ad8dc4f9-b067-4c7c-9336-bb0d33c6a93a', '96c33b2f-5b80-4a47-b713-b89ba4451365'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:23:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:23:45 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:23:45 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:23:46 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 09 17:23:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:23:46 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:23:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Deleted volume successfully. Jul 09 17:23:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5c30a8d9-8e35-4c28-8120-c6e748f40a18 tempest-TestStampPattern-1288890416 None] Lock "cinder-a645a322-1ef7-4fdf-bd42-c015e8dd8e1c-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:23:55 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=23 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:23:56 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:00 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:00 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:01 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.640s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:24:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:24:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (6698f377-6bf7-457c-a52b-18e218b5d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c04eba-36a2-48f6-9f46-619a6cfd56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c04eba-36a2-48f6-9f46-619a6cfd56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37967677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df20613-2d92-4c2c-be1b-e763254b5495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aea989-f41c-4118-bd91-261ed62fa813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aea989-f41c-4118-bd91-261ed62fa813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dbb660-1609-4687-b9f1-a9550ef1aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dbb660-1609-4687-b9f1-a9550ef1aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df20613-2d92-4c2c-be1b-e763254b5495', 'volume_name': 'volume-2df20613-2d92-4c2c-be1b-e763254b5495', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba10248-1e42-4975-9401-ae12d066a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba10248-1e42-4975-9401-ae12d066a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686d717-752f-4ea1-8091-85ee54a455ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Volume 2df20613-2d92-4c2c-be1b-e763254b5495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df20613-2d92-4c2c-be1b-e763254b5495', 'volume_size': 1} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37967677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df20613-2d92-4c2c-be1b-e763254b5495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Creating volume 2df20613-2d92-4c2c-be1b-e763254b5495 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:09 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:10 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 1073741824 Jul 09 17:24:10 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (acbace2b-9b88-4d9e-a483-23b3a09fd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a48a0f-7541-47a5-bcd6-193df35af7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a48a0f-7541-47a5-bcd6-193df35af7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651517290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d8ccca-36c2-4825-9560-454ac6282d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86653fd-8209-435d-8b3a-a4333e65d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86653fd-8209-435d-8b3a-a4333e65d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b125d506-0859-4a2c-892d-df5edbcef602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b125d506-0859-4a2c-892d-df5edbcef602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d8ccca-36c2-4825-9560-454ac6282d77', 'volume_name': 'volume-c4d8ccca-36c2-4825-9560-454ac6282d77', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84accb56-75d4-401f-b9d1-861946433d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84accb56-75d4-401f-b9d1-861946433d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e3ec39-ed3e-4a34-a706-cc2fec6f1815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume c4d8ccca-36c2-4825-9560-454ac6282d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d8ccca-36c2-4825-9560-454ac6282d77', 'volume_size': 1} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (5695c5b6-2fd5-45bb-86e8-5ab52b77445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968848c0-67cb-48a6-af87-389320a871e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968848c0-67cb-48a6-af87-389320a871e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-818288883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12a81ac-02ed-4aaf-a551-aa7c47c7ed66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413d1c7-21d5-4a7b-9251-655be807617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413d1c7-21d5-4a7b-9251-655be807617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf23cd6-8545-4568-a64e-41951a4c352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf23cd6-8545-4568-a64e-41951a4c352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12a81ac-02ed-4aaf-a551-aa7c47c7ed66', 'volume_name': 'volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3766d966-1a10-4a61-b3fb-92ab9581411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3766d966-1a10-4a61-b3fb-92ab9581411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a0ed91-37c6-4452-9e64-ba0482e88c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Volume f12a81ac-02ed-4aaf-a551-aa7c47c7ed66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66', 'volume_size': 1} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (ea2609a2-1933-4d42-9961-2b28c918da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f624ca5-d95a-4fbb-8e1b-d8dccb22a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f624ca5-d95a-4fbb-8e1b-d8dccb22a285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648900326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3810eb8-19c3-41a3-8757-99464406ce5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:11Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebea145-d29c-4757-ab61-0a12697d2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebea145-d29c-4757-ab61-0a12697d2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65815612-0101-47f7-aaae-850f14bb3625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65815612-0101-47f7-aaae-850f14bb3625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3810eb8-19c3-41a3-8757-99464406ce5c', 'volume_name': 'volume-f3810eb8-19c3-41a3-8757-99464406ce5c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf7b0c1-054d-4054-90e8-1b1a0d7fdb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf7b0c1-054d-4054-90e8-1b1a0d7fdb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61244a60-c87b-453f-a8b6-57635d6eddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:10 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Volume f3810eb8-19c3-41a3-8757-99464406ce5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3810eb8-19c3-41a3-8757-99464406ce5c', 'volume_size': 1} Jul 09 17:24:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:11 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (7fa33d8e-6c25-4174-b3f6-c47aebc53ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b2e1c3-aba9-4559-8e42-e76e3331e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 1073741824" returned: 0 in 1.259s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b2e1c3-aba9-4559-8e42-e76e3331e009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485773511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb1c718-e2c3-47e5-93d4-1d5e43a180ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:11Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4024b52e-e571-4ddb-bf9a-0689c93b7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4024b52e-e571-4ddb-bf9a-0689c93b7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd28800-92c8-45d8-9c99-1660d04c7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd28800-92c8-45d8-9c99-1660d04c7247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb1c718-e2c3-47e5-93d4-1d5e43a180ae', 'volume_name': 'volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df458a5c-6009-46b2-b5ed-cd708b3039db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df458a5c-6009-46b2-b5ed-cd708b3039db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5010c-c311-4d62-b855-6b7ca81a5de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Volume 4bb1c718-e2c3-47e5-93d4-1d5e43a180ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae', 'volume_size': 1} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:11 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 Jul 09 17:24:11 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (e392df56-2d06-4dfd-906a-6e1d3b57aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f186d54-2a0a-4859-b677-eb2635b058c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f186d54-2a0a-4859-b677-eb2635b058c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627415130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5760ed-f96e-4458-89e6-b87a42aec31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:12Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb6cb95-992b-4fca-a57c-17aa30e8d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb6cb95-992b-4fca-a57c-17aa30e8d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bcbce4-ba41-4650-9e38-2d5812493902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bcbce4-ba41-4650-9e38-2d5812493902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5760ed-f96e-4458-89e6-b87a42aec31c', 'volume_name': 'volume-1e5760ed-f96e-4458-89e6-b87a42aec31c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c248176-78d3-4ed5-bc4b-497730711d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c248176-78d3-4ed5-bc4b-497730711d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6acc953-8e77-4734-a2bb-8c9c15611e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Volume 1e5760ed-f96e-4458-89e6-b87a42aec31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5760ed-f96e-4458-89e6-b87a42aec31c', 'volume_size': 1} Jul 09 17:24:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:12 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495" returned: 0 in 0.799s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651517290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d8ccca-36c2-4825-9560-454ac6282d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:12 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 1073741824 Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686d717-752f-4ea1-8091-85ee54a455ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df20613-2d92-4c2c-be1b-e763254b5495', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:12 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaf6a28-35f7-4a28-ab21-0d71a0d6a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:12 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Volume volume-2df20613-2d92-4c2c-be1b-e763254b5495 (2df20613-2d92-4c2c-be1b-e763254b5495): created successfully Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaf6a28-35f7-4a28-ab21-0d71a0d6a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:12 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (6698f377-6bf7-457c-a52b-18e218b5d112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5f8c46fd-06c0-46c0-83fa-c13f438c0bc0 tempest-CreateVolumesFromImageTest-1284719020 None] Created volume successfully. Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Flow 'volume_create_manager' (7ccd0d71-56aa-487f-944d-76c1d595a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da57e95f-c4b7-4993-80e6-3cf8cbc8eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da57e95f-c4b7-4993-80e6-3cf8cbc8eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e84d9f-cfca-4cd2-bcce-3c7d42703f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab975cd2c7a4c018e0a1d4578304a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:13Z,use_quota=True,user_id='08fadeaca6a7403f9f1be6831b459ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c04378-7a29-4978-b1be-25dccd849ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c04378-7a29-4978-b1be-25dccd849ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d89a8b-bd26-4d19-a210-92fa627b0c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 1073741824" returned: 0 in 0.991s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:13 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 Jul 09 17:24:13 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d89a8b-bd26-4d19-a210-92fa627b0c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17e84d9f-cfca-4cd2-bcce-3c7d42703f66', 'volume_name': 'volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66', 'volume_size': 1, 'image_id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24fa8384925a75374a6b63ef06a294b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab975cd2c7a4c018e0a1d4578304a61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0821aa38e7349156c49e01ec2c90ab331a2ca57685845714708ef1e0bf331efbf219c04a53c8f42f2ee635b4ff2c8c8ac0d3e75a1ee02454ee3c99f641e1a080', 'id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7b4b425-9639-45b9-ab96-72648777c9fb/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661a4333-c381-47a1-8fe6-ab8ccaa4641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661a4333-c381-47a1-8fe6-ab8ccaa4641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5478032a-5b55-40a2-aece-12eabd557009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66', 'volume_size': 1, 'image_id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24fa8384925a75374a6b63ef06a294b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab975cd2c7a4c018e0a1d4578304a61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0821aa38e7349156c49e01ec2c90ab331a2ca57685845714708ef1e0bf331efbf219c04a53c8f42f2ee635b4ff2c8c8ac0d3e75a1ee02454ee3c99f641e1a080', 'id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7b4b425-9639-45b9-ab96-72648777c9fb/file', 'properties': {}}, 'image_service': } Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Trying to clone 17e84d9f-cfca-4cd2-bcce-3c7d42703f66 from image d7b4b425-9639-45b9-ab96-72648777c9fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:24:13 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Image download 0.00 MB at 0.00 MB/s Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d5d9c-0a65-4aa7-8f0e-4c200ceb9a3d]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:13 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77" returned: 0 in 0.683s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:13 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:13 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.445s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-818288883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12a81ac-02ed-4aaf-a551-aa7c47c7ed66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:10Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Creating volume f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:13 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e3ec39-ed3e-4a34-a706-cc2fec6f1815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d8ccca-36c2-4825-9560-454ac6282d77', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d8713c-4aec-42f9-8790-11b941d55aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:13 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 1073741824 Jul 09 17:24:13 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-c4d8ccca-36c2-4825-9560-454ac6282d77 (c4d8ccca-36c2-4825-9560-454ac6282d77): created successfully Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d8713c-4aec-42f9-8790-11b941d55aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (acbace2b-9b88-4d9e-a483-23b3a09fd09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-60faabef-9aa8-461d-9531-9f1e0d5bf708 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Flow 'volume_create_manager' (ea29b3c9-2db6-46e8-89c3-90094fe08bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d1958f-ba65-4ef8-ad6a-7c3d3d7b705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d1958f-ba65-4ef8-ad6a-7c3d3d7b705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaef7c7-9e66-452f-bd82-4f4d4ac2e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0adb6310664a58bb94a6f42e5bf9b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:14Z,use_quota=True,user_id='5d8caec3d35c44a7bbc221e6df916f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6054355a-1d09-4121-a9ba-a5fe5011fec2),volume_type_id=6054355a-1d09-4121-a9ba-a5fe5011fec2)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fcfebe-a2cc-4518-bbaa-f27d019765c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fcfebe-a2cc-4518-bbaa-f27d019765c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f188065a-9da3-4631-be1d-b7f8ba7a03df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.image.glance [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Creating Keystone auth plugin from conf {{(pid=86876) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f188065a-9da3-4631-be1d-b7f8ba7a03df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aaaef7c7-9e66-452f-bd82-4f4d4ac2e573', 'volume_name': 'volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573', 'volume_size': 1, 'image_id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a1a2b55ce2f172a324df31cac96f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf0adb6310664a58bb94a6f42e5bf9b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8354174f068381d495e3bb34bcc7860f0393a2094c878d84d454b5e30a084d1ce239c5486bb50be2d1299349c5e747b604b3d954d45bbc0aab7f19785ed1654', 'id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e37a705-b940-4d33-84e0-eee5853119bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36a7e95-ead3-4d22-b1a2-d5df27a90278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36a7e95-ead3-4d22-b1a2-d5df27a90278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1b4d56-1b27-48cd-bdbd-0bb3a582703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573', 'volume_size': 1, 'image_id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a1a2b55ce2f172a324df31cac96f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf0adb6310664a58bb94a6f42e5bf9b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8354174f068381d495e3bb34bcc7860f0393a2094c878d84d454b5e30a084d1ce239c5486bb50be2d1299349c5e747b604b3d954d45bbc0aab7f19785ed1654', 'id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e37a705-b940-4d33-84e0-eee5853119bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Trying to clone aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 from image 1e37a705-b940-4d33-84e0-eee5853119bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}]). {{(pid=86876) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 17:24:14 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Image download 0.00 MB at 0.00 MB/s Jul 09 17:24:14 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 0 in 0.920s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa9aa0-6d3c-4abe-b5c4-2fea6bfc2162]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:14 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:14 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:14 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:14 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:14 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 1073741824" returned: 0 in 0.915s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:14 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 Jul 09 17:24:14 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:15 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:15 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 1 in 0.891s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Temporary image d7b4b425-9639-45b9-ab96-72648777c9fb is fetched for user 08fadeaca6a7403f9f1be6831b459ec8. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:24:15 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:15 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28e106-6719-47c8-8d2d-3894db9c6d48]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:15 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" returned: 0 in 0.814s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.921s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648900326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3810eb8-19c3-41a3-8757-99464406ce5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:11Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Creating volume f3810eb8-19c3-41a3-8757-99464406ce5c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:15 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a0ed91-37c6-4452-9e64-ba0482e88c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:15 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:15 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c1f73a-c539-4d32-86dd-7a103849c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:15 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c 1073741824 Jul 09 17:24:15 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Volume volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 (f12a81ac-02ed-4aaf-a551-aa7c47c7ed66): created successfully Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c1f73a-c539-4d32-86dd-7a103849c952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (5695c5b6-2fd5-45bb-86e8-5ab52b77445b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3746642a-d9f7-4e80-98fe-bfd722b69acf tempest-CreateVolumesFromImageTest-1284719020 None] Created volume successfully. Jul 09 17:24:16 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Temporary image 1e37a705-b940-4d33-84e0-eee5853119bc is fetched for user 5d8caec3d35c44a7bbc221e6df916f7e. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e1a6a-5159-447c-ae5e-7108078e6310]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:16 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 0 in 0.824s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:16 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:16 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:16 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:16 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:16 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c 1073741824" returned: 0 in 1.004s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:16 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c Jul 09 17:24:16 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:17 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:17 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 1 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:17 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:17 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:17 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.147s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485773511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb1c718-e2c3-47e5-93d4-1d5e43a180ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:11Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Creating volume 4bb1c718-e2c3-47e5-93d4-1d5e43a180ae {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:17 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61244a60-c87b-453f-a8b6-57635d6eddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3810eb8-19c3-41a3-8757-99464406ce5c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:17 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae 1073741824 Jul 09 17:24:17 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf24acb-4d06-4dda-bb48-27680ad58dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Volume volume-f3810eb8-19c3-41a3-8757-99464406ce5c (f3810eb8-19c3-41a3-8757-99464406ce5c): created successfully Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf24acb-4d06-4dda-bb48-27680ad58dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (ea2609a2-1933-4d42-9961-2b28c918da07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8cddce04-4477-432e-aa91-3fc17737903d tempest-CreateVolumesFromImageTest-1284719020 None] Created volume successfully. Jul 09 17:24:17 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:18 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae 1073741824" returned: 0 in 0.954s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:18 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae Jul 09 17:24:18 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:19 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" returned: 0 in 0.686s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627415130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5760ed-f96e-4458-89e6-b87a42aec31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a5dd26de34908a72418cc567497af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:12Z,use_quota=True,user_id='c143e0d345184453b2754cdfa80522a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Creating volume 1e5760ed-f96e-4458-89e6-b87a42aec31c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5010c-c311-4d62-b855-6b7ca81a5de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:19 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c 1073741824 Jul 09 17:24:19 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d068d32-0adb-4b26-9982-4bd8ac8da995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Volume volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae (4bb1c718-e2c3-47e5-93d4-1d5e43a180ae): created successfully Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d068d32-0adb-4b26-9982-4bd8ac8da995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (7fa33d8e-6c25-4174-b3f6-c47aebc53ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2de14a75-db90-4fd0-bd1c-4a4cb9d76a57 tempest-CreateVolumesFromImageTest-1284719020 None] Created volume successfully. Jul 09 17:24:20 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c 1073741824" returned: 0 in 0.833s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:20 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c Jul 09 17:24:20 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:20 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c" returned: 0 in 0.635s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.268s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating offline snapshot 3f0826a1-57ec-4e21-9948-19b54907c768 of volume c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6acc953-8e77-4734-a2bb-8c9c15611e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5760ed-f96e-4458-89e6-b87a42aec31c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04da2a14-1a0d-48a4-acf0-a58ada176906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3b5512-105e-4d51-bb0f-7ea1493d11de]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:20 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Volume volume-1e5760ed-f96e-4458-89e6-b87a42aec31c (1e5760ed-f96e-4458-89e6-b87a42aec31c): created successfully Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04da2a14-1a0d-48a4-acf0-a58ada176906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:20 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Flow 'volume_create_manager' (e392df56-2d06-4dfd-906a-6e1d3b57aee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3a07e026-973d-459f-80d5-aa0f06028a6d tempest-CreateVolumesFromImageTest-1284719020 None] Created volume successfully. Jul 09 17:24:20 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 Jul 09 17:24:20 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:21 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77" returned: 0 in 0.754s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:21 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 1G Jul 09 17:24:21 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-1e5760ed-f96e-4458-89e6-b87a42aec31c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-1e5760ed-f96e-4458-89e6-b87a42aec31c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-quobyte-1e5760ed-f96e-4458-89e6-b87a42aec31c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-1e5760ed-f96e-4458-89e6-b87a42aec31c" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e18dfc9-a70f-4ad7-aa31-865567f443d5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:21 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c Jul 09 17:24:21 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:22 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 1G" returned: 0 in 0.845s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d8ccca-36c2-4825-9560-454ac6282d77 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:22 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d8ccca-36c2-4825-9560-454ac6282d77 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 Jul 09 17:24:22 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:22 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c" returned: 0 in 0.828s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:22 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c Jul 09 17:24:22 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:23 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d8ccca-36c2-4825-9560-454ac6282d77 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:23 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 is being set with open permissions: ugo+rw Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:23 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 Jul 09 17:24:23 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:23 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-1e5760ed-f96e-4458-89e6-b87a42aec31c" returned: 0 in 0.668s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-1e5760ed-f96e-4458-89e6-b87a42aec31c" released by "delete_volume" :: held 1.541s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Created reservations ['6e402745-9d93-4042-a9fe-faba80db3259', '3ed808d9-9045-4fb5-aec4-7d09e074e8c0', '0c4f274f-41b4-4e93-9dd8-83a2616e6cdb', 'd4175fa3-2ecf-4023-a11e-1645f73ee5fd'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:23 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:23 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:23 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:23 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info Jul 09 17:24:23 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-quobyte-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e45c728-bb3a-4688-be25-0a96d4453cfe]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:24 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Deleted volume successfully. Jul 09 17:24:24 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae Jul 09 17:24:24 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-3670be3b-e54f-4733-a870-1c82c234929c tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-1e5760ed-f96e-4458-89e6-b87a42aec31c-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:24 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info" returned: 0 in 0.665s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:24 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info is being set with open permissions: ugo+rw Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:24 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info Jul 09 17:24:24 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:24 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" returned: 0 in 0.751s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:24 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae Jul 09 17:24:24 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:25 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.info" returned: 0 in 0.634s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.890s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e84d9f-cfca-4cd2-bcce-3c7d42703f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab975cd2c7a4c018e0a1d4578304a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:13Z,use_quota=True,user_id='08fadeaca6a7403f9f1be6831b459ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Creating volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:25 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:25 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1073741824 Jul 09 17:24:25 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-783b2a51-a91f-4a18-91b3-a297741e46cf tempest-CreateVolumesFromSnapshotTest-1273225900 None] Create snapshot completed successfully Jul 09 17:24:25 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" returned: 0 in 0.633s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae" released by "delete_volume" :: held 1.431s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Created reservations ['c17e2ce0-2c09-4f6f-a8fb-2f85d7bc76ed', '1a2f4361-efbd-4094-83e8-71301e553180', '6cd0d051-b121-4be0-bd35-7716ed789fd7', '70706615-5a78-48d1-9521-8a0e3639a48d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:25 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:25 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:26 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1073741824" returned: 0 in 0.978s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-f3810eb8-19c3-41a3-8757-99464406ce5c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:26 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:26 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-f3810eb8-19c3-41a3-8757-99464406ce5c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-quobyte-f3810eb8-19c3-41a3-8757-99464406ce5c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-f3810eb8-19c3-41a3-8757-99464406ce5c" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:26 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:26 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Deleted volume successfully. Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b9ed8-4603-4405-9205-69e0d44f45ca]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-deea74b1-9f4c-4c42-a9ef-fa350ca6cc10 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-4bb1c718-e2c3-47e5-93d4-1d5e43a180ae-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (3573c89d-eb36-4fa6-ad36-39aca2385fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12966211-0d26-45d1-8e7b-9efbc90d5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12966211-0d26-45d1-8e7b-9efbc90d5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404941657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63ee53-a0d7-449e-ab70-1f770d9d63b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:26Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68aadc78-c8cd-4d8c-9596-6c2a7803da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68aadc78-c8cd-4d8c-9596-6c2a7803da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf905bff-808e-4fe8-9797-c1278884013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf905bff-808e-4fe8-9797-c1278884013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab63ee53-a0d7-449e-ab70-1f770d9d63b4', 'volume_name': 'volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3831643-ad05-4720-8968-5a5e1d238f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3831643-ad05-4720-8968-5a5e1d238f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669930e9-ff57-450b-b1da-60bc914b42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume ab63ee53-a0d7-449e-ab70-1f770d9d63b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4', 'volume_size': 1} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (0739575e-cece-4ee7-9236-e228f9c68439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54450a1d-0db0-4a29-a9a8-b042ff79f4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54450a1d-0db0-4a29-a9a8-b042ff79f4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834814085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ae102-2510-47c0-b6ca-f7dbb93c4267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:27Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f674c9-6ea1-466e-990a-e430c5a78dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f674c9-6ea1-466e-990a-e430c5a78dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0481f98-ab37-43ba-9d02-969193ed9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0481f98-ab37-43ba-9d02-969193ed9989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0ae102-2510-47c0-b6ca-f7dbb93c4267', 'volume_name': 'volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1cfbf2-de3d-4cab-9a29-e714044a54a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1cfbf2-de3d-4cab-9a29-e714044a54a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea22c242-ce5d-4bab-a317-ce1b04b6252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:26 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume ef0ae102-2510-47c0-b6ca-f7dbb93c4267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267', 'volume_size': 1} Jul 09 17:24:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:27 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 0 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.149s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaef7c7-9e66-452f-bd82-4f4d4ac2e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0adb6310664a58bb94a6f42e5bf9b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:14Z,use_quota=True,user_id='5d8caec3d35c44a7bbc221e6df916f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6054355a-1d09-4121-a9ba-a5fe5011fec2),volume_type_id=6054355a-1d09-4121-a9ba-a5fe5011fec2)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Creating volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:27 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:27 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1073741824 Jul 09 17:24:27 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Attempting download of d7b4b425-9639-45b9-ab96-72648777c9fb ((None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}])) to volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[46389a8c-814b-440a-91a5-bd6971fc6133]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:27 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8 Jul 09 17:24:27 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:27 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (afcc2e1d-8944-41d3-a2ba-706590160d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c09b76f-2ea2-4dc1-9bd4-b04a4108dc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c" returned: 0 in 1.082s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c09b76f-2ea2-4dc1-9bd4-b04a4108dc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073398242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f2d3f8-e25e-4d2d-9688-0d61c03ce690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:27Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d533e7-48e6-4e64-9f60-0e6d711b808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c Jul 09 17:24:27 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d533e7-48e6-4e64-9f60-0e6d711b808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb89b37-7e18-45cc-8c79-e040405aa4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb89b37-7e18-45cc-8c79-e040405aa4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f2d3f8-e25e-4d2d-9688-0d61c03ce690', 'volume_name': 'volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581e4321-2d5e-4dad-b04c-f059824d6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581e4321-2d5e-4dad-b04c-f059824d6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6f3a6c-9e75-441b-8ccd-e6636aa1910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume d1f2d3f8-e25e-4d2d-9688-0d61c03ce690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690', 'volume_size': 1} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (46766666-8b34-44ec-89ce-bfe937a3ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa0f94-b933-40be-bbd3-fb2c0b7be447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa0f94-b933-40be-bbd3-fb2c0b7be447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020319038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1db1b8-a3ef-4735-824b-db0beb7b7a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:28Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b9f99e-e1c9-4b50-bb23-3364a4e024d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b9f99e-e1c9-4b50-bb23-3364a4e024d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f525ef-9220-4698-8d60-d2fd7b33fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f525ef-9220-4698-8d60-d2fd7b33fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1db1b8-a3ef-4735-824b-db0beb7b7a67', 'volume_name': 'volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421afe52-0cbb-42ee-851c-db4980ec11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421afe52-0cbb-42ee-851c-db4980ec11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e641f5-f7ec-407d-9713-6d4cac82bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume 4c1db1b8-a3ef-4735-824b-db0beb7b7a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67', 'volume_size': 1} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:28 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (49815fa7-fdd5-4da4-a559-7f95a3dc4b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff72887-b1dc-44d2-a27a-39fa7a6b5ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8" returned: 0 in 1.166s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:28 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff72887-b1dc-44d2-a27a-39fa7a6b5ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916367660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7515a4-a475-4e73-958c-eb008722bd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:28Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d65cd0-424d-4b69-b7dd-f7415fb8bd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d65cd0-424d-4b69-b7dd-f7415fb8bd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b2ba4d-7e05-4e6d-802d-b473e90315c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b2ba4d-7e05-4e6d-802d-b473e90315c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7515a4-a475-4e73-958c-eb008722bd3d', 'volume_name': 'volume-0c7515a4-a475-4e73-958c-eb008722bd3d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f391da-2b22-4e7c-8c40-0197cdc6ce5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f391da-2b22-4e7c-8c40-0197cdc6ce5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955daa50-26f8-4d4d-97e7-0d379cfbdca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:28 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume 0c7515a4-a475-4e73-958c-eb008722bd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7515a4-a475-4e73-958c-eb008722bd3d', 'volume_size': 1} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1073741824" returned: 0 in 1.385s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f3810eb8-19c3-41a3-8757-99464406ce5c" returned: 0 in 0.967s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-f3810eb8-19c3-41a3-8757-99464406ce5c" released by "delete_volume" :: held 2.136s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:28 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8 Jul 09 17:24:28 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:28 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:28 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Created reservations ['5cf33f21-8542-4123-a0d5-c5722060db8a', 'f27b33c6-46d3-4c23-9fc2-b8916fd60a43', '2407f5fc-7a24-4500-90f0-6b11c42e1e45', 'a5ab8038-c928-48cd-971e-3e73acbbe70a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:28 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:28 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:29 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.612s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404941657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63ee53-a0d7-449e-ab70-1f770d9d63b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:26Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume ab63ee53-a0d7-449e-ab70-1f770d9d63b4 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:29 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:29 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 1073741824 Jul 09 17:24:29 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Attempting download of 1e37a705-b940-4d33-84e0-eee5853119bc ((None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}])) to volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 17:24:29 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8" returned: 1 in 0.901s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d7b4b425-9639-45b9-ab96-72648777c9fb_wju9t6h8' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f160a-f7aa-40ed-a514-46585f9c52fb]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:29 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Deleted volume successfully. Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f37777-5097-4081-854d-358785a9dbf3]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0fa26149-9d3c-485f-b6cf-441891cad35b tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-f3810eb8-19c3-41a3-8757-99464406ce5c-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:29 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:29 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:29 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi Jul 09 17:24:29 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-quobyte-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a5bf1e-1b9a-4013-bdff-3cb2db15222c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:29 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 Jul 09 17:24:29 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:30 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:30 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 1073741824" returned: 0 in 0.939s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi" returned: 0 in 0.788s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:30 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:30 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 Jul 09 17:24:30 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:30 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi Jul 09 17:24:30 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:30 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD Jul 09 17:24:30 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:30 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" returned: 0 in 0.915s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:30 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66 Jul 09 17:24:30 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:30 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" returned: 0 in 0.778s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.023s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834814085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ae102-2510-47c0-b6ca-f7dbb93c4267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:27Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume ef0ae102-2510-47c0-b6ca-f7dbb93c4267 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:30 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669930e9-ff57-450b-b1da-60bc914b42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:31 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 1073741824 Jul 09 17:24:31 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b61823-d6db-4e64-af00-e4d01d573f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:31 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi" returned: 1 in 0.907s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e37a705-b940-4d33-84e0-eee5853119bc_0ekhoudi' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa50ce-f5be-42b8-a0ba-2afbc9733500]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 (ab63ee53-a0d7-449e-ab70-1f770d9d63b4): created successfully Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b61823-d6db-4e64-af00-e4d01d573f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (3573c89d-eb36-4fa6-ad36-39aca2385fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4b375ae3-fc27-4ef5-8bd8-48f9f3c68cfe tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:31 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD" returned: 1 in 0.914s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] d7b4b425-9639-45b9-ab96-72648777c9fb was raw, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:31 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:31 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:31 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:31 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:31 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" returned: 0 in 0.725s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66" released by "delete_volume" :: held 1.698s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Created reservations ['abb790ed-a45c-4590-88a6-4f2bebaf5243', 'b99f9f04-ed21-4022-8fe9-1d6f2c4ec692', '0aeea2fb-7e23-42a0-9260-5bccbb7aed85', 'd7803c1f-2ac2-4205-b95f-0ea86bf3cf34'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:31 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:31 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:31 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-2df20613-2d92-4c2c-be1b-e763254b5495-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-2df20613-2d92-4c2c-be1b-e763254b5495-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:32 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD Jul 09 17:24:32 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:32 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 1073741824" returned: 0 in 1.088s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "cinder-quobyte-2df20613-2d92-4c2c-be1b-e763254b5495" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:32 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 0 in 0.957s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d7b4b425-9639-45b9-ab96-72648777c9fb_cm65ya7_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:24:32 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-2df20613-2d92-4c2c-be1b-e763254b5495" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:32 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1G Jul 09 17:24:32 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704d644-41aa-40b6-95b6-13c36001ff03]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:32 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 Jul 09 17:24:32 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:32 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 Jul 09 17:24:32 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:32 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.966s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Deleted volume successfully. Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d8bd4c1c-1ae4-4c10-879c-937a8d480949 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-f12a81ac-02ed-4aaf-a551-aa7c47c7ed66-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:32 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD" returned: 1 in 0.889s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] 1e37a705-b940-4d33-84e0-eee5853119bc was raw, converting to raw {{(pid=86876) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 17:24:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:32 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:32 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:33 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 1G" returned: 0 in 0.920s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12aa1b-7952-40b4-92ad-0b84339183ce]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:33 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" returned: 0 in 0.930s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.563s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073398242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f2d3f8-e25e-4d2d-9688-0d61c03ce690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:27Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:33 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:33 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 1073741824 Jul 09 17:24:33 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea22c242-ce5d-4bab-a317-ce1b04b6252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21859bd0-65f3-4b41-a329-4dd29ba41147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:33 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:33 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 (ef0ae102-2510-47c0-b6ca-f7dbb93c4267): created successfully Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21859bd0-65f3-4b41-a329-4dd29ba41147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (0739575e-cece-4ee7-9236-e228f9c68439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-dce86efb-727f-4898-8779-894949702470 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:33 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495" returned: 0 in 1.227s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:33 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495 Jul 09 17:24:33 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:33 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 0 in 0.813s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e37a705-b940-4d33-84e0-eee5853119bc_wq6obnzndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:24:33 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 17:24:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:33 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1G Jul 09 17:24:33 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:34 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 0 in 0.987s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:34 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-2df20613-2d92-4c2c-be1b-e763254b5495" returned: 0 in 0.719s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-quobyte-2df20613-2d92-4c2c-be1b-e763254b5495" released by "delete_volume" :: held 1.992s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:34 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:34 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Created reservations ['b1e198f7-dfc8-4159-922b-553610dcfe91', 'd1efbf05-1a48-432b-9c66-ce552f95060a', 'a363cf4b-6a5e-41f1-a219-5a84c65d9c52', '8d48d06d-1923-491a-a6c8-4ff1f582f1fd'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:34 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 1073741824" returned: 0 in 1.121s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:34 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:34 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:34 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 Jul 09 17:24:34 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:34 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 1G" returned: 0 in 0.857s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade7942-2e1e-4cf5-aed0-259101a66b8f]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:34 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:34 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:34 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 1 in 0.900s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Downloaded image d7b4b425-9639-45b9-ab96-72648777c9fb ((None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}])) to volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Temporary image d7b4b425-9639-45b9-ab96-72648777c9fb for user 08fadeaca6a7403f9f1be6831b459ec8 is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:24:34 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Marking volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Copying metadata from image d7b4b425-9639-45b9-ab96-72648777c9fb to 17e84d9f-cfca-4cd2-bcce-3c7d42703f66. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Creating volume glance metadata for volume 17e84d9f-cfca-4cd2-bcce-3c7d42703f66 backed by image d7b4b425-9639-45b9-ab96-72648777c9fb with: {'image_id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '24fa8384925a75374a6b63ef06a294b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5478032a-5b55-40a2-aece-12eabd557009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66', 'volume_size': 1, 'image_id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d7b4b425-9639-45b9-ab96-72648777c9fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24fa8384925a75374a6b63ef06a294b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ab975cd2c7a4c018e0a1d4578304a61', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0821aa38e7349156c49e01ec2c90ab331a2ca57685845714708ef1e0bf331efbf219c04a53c8f42f2ee635b4ff2c8c8ac0d3e75a1ee02454ee3c99f641e1a080', 'id': 'd7b4b425-9639-45b9-ab96-72648777c9fb', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d7b4b425-9639-45b9-ab96-72648777c9fb/file', 'properties': {}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:35 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5bd15e-1c55-4507-a96d-52bdf63f2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.769s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Deleted volume successfully. Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Volume volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 (17e84d9f-cfca-4cd2-bcce-3c7d42703f66): created successfully Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5bd15e-1c55-4507-a96d-52bdf63f2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:35 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Flow 'volume_create_manager' (7ccd0d71-56aa-487f-944d-76c1d595a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" returned: 0 in 0.787s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.118s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1020319038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1db1b8-a3ef-4735-824b-db0beb7b7a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:28Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume 4c1db1b8-a3ef-4735-824b-db0beb7b7a67 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b391e75b-4aba-4205-b639-6dc090590f1f tempest-VolumeImageDependencyTests-1395637355 None] Created volume successfully. Jul 09 17:24:35 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 1073741824 Jul 09 17:24:35 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6f3a6c-9e75-441b-8ccd-e6636aa1910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7902d-464f-4ca5-9d28-d7acf8adec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-811ed900-930a-472a-b9aa-f3ad67c308a4 tempest-CreateVolumesFromImageTest-1284719020 None] Lock "cinder-2df20613-2d92-4c2c-be1b-e763254b5495-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 (d1f2d3f8-e25e-4d2d-9688-0d61c03ce690): created successfully Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7902d-464f-4ca5-9d28-d7acf8adec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (afcc2e1d-8944-41d3-a2ba-706590160d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:35 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-97afc9cd-2dd1-45bf-a88a-98f44d352ce2 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:35 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 0 in 0.868s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:35 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:35 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Acquiring lock "cinder-17e84d9f-cfca-4cd2-bcce-3c7d42703f66-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "cinder-17e84d9f-cfca-4cd2-bcce-3c7d42703f66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Acquiring lock "cinder-quobyte-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "cinder-quobyte-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:36 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 1073741824" returned: 0 in 1.041s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[08823e69-52d5-45a6-9237-d576fc4f11cd]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:36 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 Jul 09 17:24:36 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:36 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:36 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 1 in 0.961s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:36 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Downloaded image 1e37a705-b940-4d33-84e0-eee5853119bc ((None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}])) to volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 successfully. {{(pid=86876) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Temporary image 1e37a705-b940-4d33-84e0-eee5853119bc for user 5d8caec3d35c44a7bbc221e6df916f7e is deleted. {{(pid=86876) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.volume_utils [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Marking volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 as bootable. {{(pid=86876) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Copying metadata from image 1e37a705-b940-4d33-84e0-eee5853119bc to aaaef7c7-9e66-452f-bd82-4f4d4ac2e573. {{(pid=86876) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Creating volume glance metadata for volume aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 backed by image 1e37a705-b940-4d33-84e0-eee5853119bc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd4a1a2b55ce2f172a324df31cac96f06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86876) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1b4d56-1b27-48cd-bdbd-0bb3a582703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573', 'volume_size': 1, 'image_id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e37a705-b940-4d33-84e0-eee5853119bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd4a1a2b55ce2f172a324df31cac96f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf0adb6310664a58bb94a6f42e5bf9b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8354174f068381d495e3bb34bcc7860f0393a2094c878d84d454b5e30a084d1ce239c5486bb50be2d1299349c5e747b604b3d954d45bbc0aab7f19785ed1654', 'id': '1e37a705-b940-4d33-84e0-eee5853119bc', 'created_at': datetime.datetime(2026, 7, 9, 15, 24, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 15, 24, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e37a705-b940-4d33-84e0-eee5853119bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81d86ba-058e-4098-8c87-e3b3191dae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:36 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Volume volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 (aaaef7c7-9e66-452f-bd82-4f4d4ac2e573): created successfully Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81d86ba-058e-4098-8c87-e3b3191dae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:36 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Flow 'volume_create_manager' (ea29b3c9-2db6-46e8-89c3-90094fe08bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0c5678ad-5ade-4f3f-9ba0-cc7aa2fb3c32 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Created volume successfully. Jul 09 17:24:37 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 0 in 0.882s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:37 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" returned: 0 in 0.863s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.654s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916367660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7515a4-a475-4e73-958c-eb008722bd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eaf41174c5477c89481e9b7aae2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:28Z,use_quota=True,user_id='ad1c6093788b412b8c035c7ec375f8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Creating volume 0c7515a4-a475-4e73-958c-eb008722bd3d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:37 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d 1073741824 Jul 09 17:24:37 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e641f5-f7ec-407d-9713-6d4cac82bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60ae328-bd0c-4f22-99fc-51f41a98171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Acquiring lock "cinder-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:37 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:37 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "cinder-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 (4c1db1b8-a3ef-4735-824b-db0beb7b7a67): created successfully Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60ae328-bd0c-4f22-99fc-51f41a98171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (46766666-8b34-44ec-89ce-bfe937a3ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5bfe429c-818a-4002-b1b0-db17ca010faa tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Acquiring lock "cinder-quobyte-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "cinder-quobyte-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8be755-b942-43e2-8831-6a4c9070cabd]: (4, 'raw') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:37 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:37 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:38 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 1 in 0.991s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:38 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66 Jul 09 17:24:38 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:38 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d 1073741824" returned: 0 in 1.003s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:38 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d Jul 09 17:24:38 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:38 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 0 in 1.032s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:38 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:38 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:38 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" returned: 0 in 0.844s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "cinder-quobyte-17e84d9f-cfca-4cd2-bcce-3c7d42703f66" released by "delete_volume" :: held 2.826s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:38 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d" returned: 0 in 0.776s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955daa50-26f8-4d4d-97e7-0d379cfbdca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7515a4-a475-4e73-958c-eb008722bd3d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55f592-09f2-4715-b2ca-58b554331966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:39 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Volume volume-0c7515a4-a475-4e73-958c-eb008722bd3d (0c7515a4-a475-4e73-958c-eb008722bd3d): created successfully Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55f592-09f2-4715-b2ca-58b554331966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Flow 'volume_create_manager' (49815fa7-fdd5-4da4-a559-7f95a3dc4b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-37f649ac-7cce-4ab9-ab42-ac6bbbd6bf5d tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created volume successfully. Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Created reservations ['f5ff9a60-07d3-4e58-995b-8c64e45868e9', 'fda3f058-ae07-4a81-98ad-5df626a64892', 'd0340b47-d3fd-48c6-b469-252e9acfbf5e', '1f4b41e3-7337-4b28-8394-6542858dff65'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:39 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:39 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:39 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 1 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573' failed. Not Retrying. {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:39 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573 Jul 09 17:24:39 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-0c7515a4-a475-4e73-958c-eb008722bd3d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-0c7515a4-a475-4e73-958c-eb008722bd3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-0c7515a4-a475-4e73-958c-eb008722bd3d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-0c7515a4-a475-4e73-958c-eb008722bd3d" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0b6fa-a8c0-4184-95f7-00dbacbfa819]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:39 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d Jul 09 17:24:39 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:39 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.853s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:39 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Deleted volume successfully. Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-19f0c4db-601c-4f15-81e0-f19f14ecf265 tempest-VolumeImageDependencyTests-1395637355 None] Lock "cinder-17e84d9f-cfca-4cd2-bcce-3c7d42703f66-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:40 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" returned: 0 in 0.816s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "cinder-quobyte-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573" released by "delete_volume" :: held 2.813s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Created reservations ['7a6b7d0b-e264-4d2f-a525-3873bdf54614', 'a6d516ec-3799-45da-93ba-47ce7643d9e7', 'bca6ec02-1dc4-44e1-a5bd-4696172be937', '1d9f9bbf-caec-419d-9114-c865323b262f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:40 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:40 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:40 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d" returned: 0 in 1.023s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:40 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d Jul 09 17:24:40 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:41 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.129s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Deleted volume successfully. Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e0f62b9-4073-4b8c-adba-55f66ad67585 tempest-VolumeAndVolumeTypeFromImageTest-1032255678 None] Lock "cinder-aaaef7c7-9e66-452f-bd82-4f4d4ac2e573-delete_volume" released by "delete_volume" :: held 4.286s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:41 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-0c7515a4-a475-4e73-958c-eb008722bd3d" returned: 0 in 1.026s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-0c7515a4-a475-4e73-958c-eb008722bd3d" released by "delete_volume" :: held 2.104s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['0b1ae177-2e3c-45fa-966c-24a35cf9c821', 'e24bced5-a1a9-4ff8-89f1-e94163759a92', 'a828bd88-48a3-4bdb-90f8-96100022d599', '10ea4106-9fd4-4c71-a2e9-818ef0a570f6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:42 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:42 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:42 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.909s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:24:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b06fccd2-8c85-4feb-bc88-3f2fa4be9ceb tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-0c7515a4-a475-4e73-958c-eb008722bd3d-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-4c1db1b8-a3ef-4735-824b-db0beb7b7a67-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-4c1db1b8-a3ef-4735-824b-db0beb7b7a67-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fde333-5b38-4c02-9234-88cbc5ebea40]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:43 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 Jul 09 17:24:43 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Flow 'volume_create_manager' (b130c475-0f55-4c60-882d-bdf08ac40603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac6ba59-93d7-4082-a446-9523e5bf3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac6ba59-93d7-4082-a446-9523e5bf3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4a48aa-7096-4633-8bef-89befa1a9eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d60de22d0b4be5abb3b3ec775baca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:44Z,use_quota=True,user_id='cc2af07534ef4b7092642e603047d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:44 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9f39f3-2128-4232-ad6e-0307b99b1bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9f39f3-2128-4232-ad6e-0307b99b1bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76142a3-1e86-4f4e-ad7f-2f197244025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76142a3-1e86-4f4e-ad7f-2f197244025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4a48aa-7096-4633-8bef-89befa1a9eb7', 'volume_name': 'volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f648bb39-3245-406f-923f-61737806777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f648bb39-3245-406f-923f-61737806777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b49a4-0afa-4b61-b98c-dad62cd487a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:44 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Volume 3b4a48aa-7096-4633-8bef-89befa1a9eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7', 'volume_size': 1} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4a48aa-7096-4633-8bef-89befa1a9eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d60de22d0b4be5abb3b3ec775baca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:44Z,use_quota=True,user_id='cc2af07534ef4b7092642e603047d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Creating volume 3b4a48aa-7096-4633-8bef-89befa1a9eb7 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:44 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" returned: 0 in 1.068s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:44 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 1073741824 Jul 09 17:24:44 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:44 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67 Jul 09 17:24:44 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:45 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" returned: 0 in 1.060s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-4c1db1b8-a3ef-4735-824b-db0beb7b7a67" released by "delete_volume" :: held 2.217s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['56c2ddd2-ccea-49ce-af47-6be98c841eb8', '425f5e18-9ca6-4d00-9306-10f9cd3dc313', '982bc5a9-2683-4c26-b367-8e9468bc60f6', '1ed8e432-16e7-4291-a812-5c9ad6c0c296'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:45 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 1073741824" returned: 0 in 1.182s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:45 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 Jul 09 17:24:45 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:45 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:45 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:46 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7" returned: 0 in 0.742s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b49a4-0afa-4b61-b98c-dad62cd487a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a074b35-892e-4d30-b5f6-10cb91a512ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Volume volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 (3b4a48aa-7096-4633-8bef-89befa1a9eb7): created successfully Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a074b35-892e-4d30-b5f6-10cb91a512ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Flow 'volume_create_manager' (b130c475-0f55-4c60-882d-bdf08ac40603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1feaca78-b99b-4b28-a9da-ea82dd3b773a tempest-CinderUnicodeTest-1664467279 None] Created volume successfully. Jul 09 17:24:46 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.781s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b974daf8-af59-4b7d-9cdc-ba71fb48c265 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-4c1db1b8-a3ef-4735-824b-db0beb7b7a67-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Flow 'volume_create_manager' (f1ef762c-35fb-431d-8973-e7efda7202e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cec836-d75d-4b7c-aeac-7db4f164f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cec836-d75d-4b7c-aeac-7db4f164f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376712170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117d6bf7-d233-41c0-8093-99ea52fc6e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd09932390144f0ca89653c170a06b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='fd7e0cd8d4144263aed6a7841c0142eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82b9cf-9dec-4508-ad53-61f61aa70ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82b9cf-9dec-4508-ad53-61f61aa70ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ae4443-8f74-4c81-a28c-fd07d3ecb278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ae4443-8f74-4c81-a28c-fd07d3ecb278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117d6bf7-d233-41c0-8093-99ea52fc6e6c', 'volume_name': 'volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7becd7-7888-4595-b90c-dd9ca5651e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7becd7-7888-4595-b90c-dd9ca5651e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6968321-b109-4978-873e-a67acc9ebd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:46 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Volume 117d6bf7-d233-41c0-8093-99ea52fc6e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c', 'volume_size': 1} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376712170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117d6bf7-d233-41c0-8093-99ea52fc6e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd09932390144f0ca89653c170a06b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='fd7e0cd8d4144263aed6a7841c0142eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Creating volume 117d6bf7-d233-41c0-8093-99ea52fc6e6c {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:46 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:46 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c 1073741824 Jul 09 17:24:46 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Flow 'volume_create_manager' (694e01bc-f281-45ef-8260-007f5abbb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7d2243-f60c-4c3e-b447-b81f578fa65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[af405e2b-4830-4b9f-8738-e653621a81b1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7d2243-f60c-4c3e-b447-b81f578fa65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1439613554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e7d85-7475-4485-bd42-8e09f1b03c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba41aaf7ce294b4c99439aa9a555c38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='e5c6446e8abb4d35b1060eb7868fb3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1f17df-7002-4949-bfa4-709a3ab0b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1f17df-7002-4949-bfa4-709a3ab0b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9b6b15-8c4c-41f9-9d61-4eaea33a9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9b6b15-8c4c-41f9-9d61-4eaea33a9461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2e7d85-7475-4485-bd42-8e09f1b03c97', 'volume_name': 'volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b232f78-67c5-4c43-aa94-eed05f874954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b232f78-67c5-4c43-aa94-eed05f874954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f848c864-1584-45f3-a252-def95bb821c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Volume 3f2e7d85-7475-4485-bd42-8e09f1b03c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97', 'volume_size': 1} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:47 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 Jul 09 17:24:47 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Flow 'volume_create_manager' (a3c34edd-6ac0-4a6e-8042-27c84dcd2f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59f3e51-b834-4a3b-873a-cfa9a2b7f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59f3e51-b834-4a3b-873a-cfa9a2b7f09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-502411180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e814062e-1716-4409-906d-d822a24a057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d60de22d0b4be5abb3b3ec775baca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='cc2af07534ef4b7092642e603047d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96d5951-569f-4b53-86a5-4bd192e8ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96d5951-569f-4b53-86a5-4bd192e8ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8603b05-9457-4d25-9864-07b3aade50a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8603b05-9457-4d25-9864-07b3aade50a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e814062e-1716-4409-906d-d822a24a057a', 'volume_name': 'volume-e814062e-1716-4409-906d-d822a24a057a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8038adb7-cf4e-44c7-b4fd-2bb2a7dab32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8038adb7-cf4e-44c7-b4fd-2bb2a7dab32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985939ad-229e-4c63-852e-a282d5ed821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Volume e814062e-1716-4409-906d-d822a24a057a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e814062e-1716-4409-906d-d822a24a057a', 'volume_size': 1} Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:47 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c 1073741824" returned: 0 in 1.045s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:48 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c Jul 09 17:24:48 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:48 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" returned: 0 in 1.002s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:48 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690 Jul 09 17:24:48 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:48 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c" returned: 0 in 0.704s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1439613554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e7d85-7475-4485-bd42-8e09f1b03c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba41aaf7ce294b4c99439aa9a555c38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='e5c6446e8abb4d35b1060eb7868fb3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Creating volume 3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:48 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:48 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" returned: 0 in 0.683s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:48 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 1073741824 Jul 09 17:24:48 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6968321-b109-4978-873e-a67acc9ebd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024e6c04-6411-4eb3-99cc-8a4f901f7294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690" released by "delete_volume" :: held 1.786s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Volume volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c (117d6bf7-d233-41c0-8093-99ea52fc6e6c): created successfully Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024e6c04-6411-4eb3-99cc-8a4f901f7294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Flow 'volume_create_manager' (f1ef762c-35fb-431d-8973-e7efda7202e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3327b64b-de82-42a7-801c-16c3a032e6cc tempest-ProjectReaderTests-1836514534 None] Created volume successfully. Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['29bc7c84-57fb-43e8-b94c-51e3758ef90f', 'ddf068a6-1f45-4283-9c48-2409bb0160df', 'a37b8370-3ad0-4ecc-ae0f-cd7938345e34', '3a049f6a-5dbe-437c-aadb-55ea026bcc0a'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:49 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:49 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-ef0ae102-2510-47c0-b6ca-f7dbb93c4267-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-ef0ae102-2510-47c0-b6ca-f7dbb93c4267-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a8b3d9-919c-4c7b-9b5c-bdecb7c592a2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:49 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 Jul 09 17:24:49 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:49 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 1073741824" returned: 0 in 0.851s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:49 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:24:49 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:49 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:49 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-357f4ca5-b803-490e-9185-ac19a87ddf65 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-d1f2d3f8-e25e-4d2d-9688-0d61c03ce690-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:49 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" returned: 0 in 0.840s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:50 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267 Jul 09 17:24:50 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "cinder-117d6bf7-d233-41c0-8093-99ea52fc6e6c-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-117d6bf7-d233-41c0-8093-99ea52fc6e6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "cinder-quobyte-117d6bf7-d233-41c0-8093-99ea52fc6e6c" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-quobyte-117d6bf7-d233-41c0-8093-99ea52fc6e6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4162133c-bcad-4009-81f2-bfffff1b9634]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:50 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c Jul 09 17:24:50 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:50 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-502411180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e814062e-1716-4409-906d-d822a24a057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d60de22d0b4be5abb3b3ec775baca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:47Z,use_quota=True,user_id='cc2af07534ef4b7092642e603047d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Creating volume e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:24:50 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f848c864-1584-45f3-a252-def95bb821c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:50 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a 1073741824 Jul 09 17:24:50 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b808298-123d-4453-81a5-60d8afbba7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Volume volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 (3f2e7d85-7475-4485-bd42-8e09f1b03c97): created successfully Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b808298-123d-4453-81a5-60d8afbba7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Flow 'volume_create_manager' (694e01bc-f281-45ef-8260-007f5abbb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-57027f99-9b19-4948-a37e-b6b1c158c636 tempest-VolumeDependencyTests-1394256140 None] Created volume successfully. Jul 09 17:24:50 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" returned: 0 in 0.700s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-ef0ae102-2510-47c0-b6ca-f7dbb93c4267" released by "delete_volume" :: held 1.586s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['52e9de4d-366a-4fdb-9047-416ecc08f227', '5cd7085c-4808-4183-aa69-1ed3373d408b', '4b0bcefe-09bc-4c6f-a9a7-6ba95d60260e', '2077b9db-c1fa-47b8-a714-e213df037b51'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:50 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:50 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:50 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c" returned: 0 in 0.807s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:50 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c Jul 09 17:24:50 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-ab63ee53-a0d7-449e-ab70-1f770d9d63b4-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-ab63ee53-a0d7-449e-ab70-1f770d9d63b4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:51 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a 1073741824" returned: 0 in 1.090s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b44f6b-a374-48f1-aa81-05ea49e30744]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:51 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a Jul 09 17:24:51 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:51 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.776s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:24:51 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 Jul 09 17:24:51 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-61cfb546-a84a-4113-9bb1-8cd5d9a4c30c tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-ef0ae102-2510-47c0-b6ca-f7dbb93c4267-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:51 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-117d6bf7-d233-41c0-8093-99ea52fc6e6c" returned: 0 in 0.829s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-quobyte-117d6bf7-d233-41c0-8093-99ea52fc6e6c" released by "delete_volume" :: held 1.677s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Created reservations ['e997419a-d761-4349-91f5-8f9fcf368a28', 'd7ee2f93-cb19-443d-9b58-094be7bdfebc', 'f228e306-10b9-493b-959d-4bf71986e218', '4da353ce-2f9a-426c-8852-dd2ab1808c08'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:51 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:51 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:52 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a" returned: 0 in 0.649s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.762s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Creating offline snapshot 068ae40a-299f-4d6f-816f-c5963fecb5a7 of volume 3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985939ad-229e-4c63-852e-a282d5ed821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e814062e-1716-4409-906d-d822a24a057a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e097d714-ef1c-4152-8b5b-e3a56870288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b75c0-2910-4fb5-90ef-06f8c36766fd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:52 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Volume volume-e814062e-1716-4409-906d-d822a24a057a (e814062e-1716-4409-906d-d822a24a057a): created successfully Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e097d714-ef1c-4152-8b5b-e3a56870288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Flow 'volume_create_manager' (a3c34edd-6ac0-4a6e-8042-27c84dcd2f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:52 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-54af3568-0a69-4144-85b7-5e26f1b75d58 tempest-CinderUnicodeTest-1664467279 None] Created volume successfully. Jul 09 17:24:52 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" returned: 0 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:52 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4 Jul 09 17:24:52 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:52 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:24:52 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:52 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.706s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:52 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Deleted volume successfully. Jul 09 17:24:52 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7323cc24-b805-49ed-940b-ff9cba6fc400 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-117d6bf7-d233-41c0-8093-99ea52fc6e6c-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Flow 'volume_create_manager' (cd4df1ed-6ad0-4701-9680-c59d88f19980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f2dbc7-4956-421e-9f1b-9880a32fadf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f2dbc7-4956-421e-9f1b-9880a32fadf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297597844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531f3095-0288-4b3c-bcdd-d67f60ae7a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd09932390144f0ca89653c170a06b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:53Z,use_quota=True,user_id='fd7e0cd8d4144263aed6a7841c0142eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278aea14-2c01-4e42-ae7b-c94bc4a54fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278aea14-2c01-4e42-ae7b-c94bc4a54fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd134f-e842-4f9f-81ab-91a7df199d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd134f-e842-4f9f-81ab-91a7df199d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531f3095-0288-4b3c-bcdd-d67f60ae7a60', 'volume_name': 'volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af62001a-0f6b-47b4-a1ee-6f60e1038dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:53 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af62001a-0f6b-47b4-a1ee-6f60e1038dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fffb59-f7fb-4ff1-9aa5-8e6a8a88a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:53 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Volume 531f3095-0288-4b3c-bcdd-d67f60ae7a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60', 'volume_size': 1} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-ab63ee53-a0d7-449e-ab70-1f770d9d63b4" released by "delete_volume" :: held 1.747s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:53 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.980s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:53 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 1G Jul 09 17:24:53 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['c20e2e28-b8a3-4565-86de-fafef97546ef', '5c2a1b00-86b7-4428-ac46-764fc1f8c0e7', 'a982318f-07ee-4439-b153-dfd0932cfdea', '1de366ad-89a0-4bf4-8fd1-bf200945acc9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:53 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:53 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-3f0826a1-57ec-4e21-9948-19b54907c768-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-3f0826a1-57ec-4e21-9948-19b54907c768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-3f0826a1-57ec-4e21-9948-19b54907c768" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-3f0826a1-57ec-4e21-9948-19b54907c768" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleting offline snapshot 3f0826a1-57ec-4e21-9948-19b54907c768 of volume c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] snapshot_file for this snap is: volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d0ced-48b2-437d-9e22-38309ff3a0c7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:53 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 Jul 09 17:24:53 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:54 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 1G" returned: 0 in 0.858s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:54 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.692s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:24:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:24:54 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:24:54 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-653bb949-a40b-4dc5-bd1d-cd175ad36cff tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-ab63ee53-a0d7-449e-ab70-1f770d9d63b4-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:54 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768" returned: 0 in 0.765s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d8ccca-36c2-4825-9560-454ac6282d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab14b20b-efca-4bd0-981f-68348451be02]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:54 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 Jul 09 17:24:54 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:54 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 0.734s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 is being set with open permissions: ugo+rw Jul 09 17:24:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:54 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:24:54 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:55 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77" returned: 0 in 0.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:55 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 Jul 09 17:24:55 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:55 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 0.634s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:55 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info Jul 09 17:24:55 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:55 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768" returned: 0 in 0.729s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:56 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768 Jul 09 17:24:56 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:56 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info" returned: 0 in 0.666s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:56 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info is being set with open permissions: ugo+rw Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:56 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info Jul 09 17:24:56 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:56 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77.3f0826a1-57ec-4e21-9948-19b54907c768" returned: 0 in 0.659s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-3f0826a1-57ec-4e21-9948-19b54907c768" released by "_delete_snapshot" :: held 3.029s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" released by "delete_snapshot" :: held 3.051s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['51566a6a-7a15-4796-820d-14b657e15875', 'e590fdea-b17e-4544-8312-60d0d93d9e01', '44511fbb-5a66-4cfc-933b-67446138892a', '8133f66d-191a-468b-a54b-f50a0d3b58f9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:56 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.info" returned: 0 in 0.646s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.622s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.731s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Creating offline snapshot 1253fb09-ab3f-470d-ab18-f00e250d90d2 of volume e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:24:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-470f4d01-b8a8-4af1-b387-ebb102d43c4f tempest-VolumeDependencyTests-1394256140 None] Create snapshot completed successfully Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bc66a-c059-44d1-b6a0-a21e022cce48]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:56 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Delete snapshot completed successfully. Jul 09 17:24:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2d77f3d7-23ba-4475-8cbd-023de4a7e83b tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-3f0826a1-57ec-4e21-9948-19b54907c768-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:56 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a Jul 09 17:24:56 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:57 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a" returned: 0 in 0.778s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:57 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 1G Jul 09 17:24:57 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-c4d8ccca-36c2-4825-9560-454ac6282d77-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-c4d8ccca-36c2-4825-9560-454ac6282d77-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:24:57 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c218e7-7620-4563-bc7b-cc7bdfc6dd4b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:58 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 Jul 09 17:24:58 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Flow 'volume_create_manager' (5158c78a-45af-4d57-a705-094ebab08790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e15c1a-3cf8-41b3-9388-730cbc0f0af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e15c1a-3cf8-41b3-9388-730cbc0f0af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1923180674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af584d6-2094-418e-9d82-8464ff6999eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba41aaf7ce294b4c99439aa9a555c38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=068ae40a-299f-4d6f-816f-c5963fecb5a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:58Z,use_quota=True,user_id='e5c6446e8abb4d35b1060eb7868fb3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f5e35-18e2-4c93-acf7-4d79b549953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74f5e35-18e2-4c93-acf7-4d79b549953e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b5809d-df12-41c5-8f8d-87ff057e8530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b5809d-df12-41c5-8f8d-87ff057e8530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6af584d6-2094-418e-9d82-8464ff6999eb', 'volume_name': 'volume-6af584d6-2094-418e-9d82-8464ff6999eb', 'volume_size': 1, 'snapshot_id': '068ae40a-299f-4d6f-816f-c5963fecb5a7'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809ec1ca-c904-4ba6-ace0-565b6cab6347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809ec1ca-c904-4ba6-ace0-565b6cab6347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f37656b-f902-4265-a151-e01961fb861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:24:58 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Volume 6af584d6-2094-418e-9d82-8464ff6999eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6af584d6-2094-418e-9d82-8464ff6999eb', 'volume_size': 1, 'snapshot_id': '068ae40a-299f-4d6f-816f-c5963fecb5a7'} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:58 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 1G" returned: 0 in 0.903s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e814062e-1716-4409-906d-d822a24a057a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:58 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e814062e-1716-4409-906d-d822a24a057a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 Jul 09 17:24:58 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:58 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77" returned: 0 in 0.804s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:58 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77 Jul 09 17:24:58 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:59 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e814062e-1716-4409-906d-d822a24a057a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2" returned: 0 in 0.753s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:59 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 is being set with open permissions: ugo+rw Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:59 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 Jul 09 17:24:59 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:59 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c4d8ccca-36c2-4825-9560-454ac6282d77" returned: 0 in 0.668s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-quobyte-c4d8ccca-36c2-4825-9560-454ac6282d77" released by "delete_volume" :: held 1.557s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Created reservations ['895eb450-82e7-498c-ba41-6c70f0c602ff', 'c2b2b791-5aba-4ffc-a19d-81e6da1064d8', 'f7d51058-d5b0-4773-8824-b093fbd1afb8', '4876d24b-d97c-4959-bc3c-c82405180306'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:24:59 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:24:59 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:24:59 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 09 17:24:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2" returned: 0 in 0.697s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:00 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info Jul 09 17:25:00 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:00 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Deleted volume successfully. Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-610b3c5d-cd5e-41de-a728-6f3727021b64 tempest-CreateVolumesFromSnapshotTest-1273225900 None] Lock "cinder-c4d8ccca-36c2-4825-9560-454ac6282d77-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:00 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:00 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:00 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info" returned: 0 in 0.757s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:00 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info is being set with open permissions: ugo+rw Jul 09 17:25:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:00 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info Jul 09 17:25:00 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:01 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:25:01 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.info" returned: 0 in 0.758s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.390s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297597844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531f3095-0288-4b3c-bcdd-d67f60ae7a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd09932390144f0ca89653c170a06b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:24:53Z,use_quota=True,user_id='fd7e0cd8d4144263aed6a7841c0142eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Creating volume 531f3095-0288-4b3c-bcdd-d67f60ae7a60 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:01 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:01 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 1073741824 Jul 09 17:25:01 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:01 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b004b835-dcd7-43cc-adde-dd59a5316043 tempest-CinderUnicodeTest-1664467279 None] Create snapshot completed successfully Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-1253fb09-ab3f-470d-ab18-f00e250d90d2-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:02 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 1073741824" returned: 0 in 0.899s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-1253fb09-ab3f-470d-ab18-f00e250d90d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-quobyte-1253fb09-ab3f-470d-ab18-f00e250d90d2" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-1253fb09-ab3f-470d-ab18-f00e250d90d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Deleting offline snapshot 1253fb09-ab3f-470d-ab18-f00e250d90d2 of volume e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] snapshot_file for this snap is: volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[51702a24-13ce-47e0-baf0-29c91b39c2c5]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:02 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 Jul 09 17:25:02 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:02 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 Jul 09 17:25:02 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:03 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (ab97f6cc-c7d8-4230-94a8-de7c545f56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a4d436-c20b-465b-9fde-0fa414eb9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60" returned: 0 in 0.834s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.033s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7-6af584d6-2094-418e-9d82-8464ff6999eb" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a4d436-c20b-465b-9fde-0fa414eb9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926825615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:03Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592600aa-ca8e-4fbd-8328-d3d45952610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592600aa-ca8e-4fbd-8328-d3d45952610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f122c125-6ca9-45ee-8ac3-5271a3afd13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f122c125-6ca9-45ee-8ac3-5271a3afd13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef', 'volume_name': 'volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfffbbd1-a065-4926-b9f5-44fac0f00d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfffbbd1-a065-4926-b9f5-44fac0f00d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec722c-2c2d-44d9-9cb0-369e482f4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume 94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef', 'volume_size': 1} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fffb59-f7fb-4ff1-9aa5-8e6a8a88a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9341d0ac-c225-4b53-bd36-e658bf1730d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7-6af584d6-2094-418e-9d82-8464ff6999eb" acquired by "_create_volume_from_snapshot" :: waited 0.075s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Creating volume 6af584d6-2094-418e-9d82-8464ff6999eb from snapshot 068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:03 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2" returned: 0 in 0.922s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e814062e-1716-4409-906d-d822a24a057a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:25:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Volume volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 (531f3095-0288-4b3c-bcdd-d67f60ae7a60): created successfully Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9341d0ac-c225-4b53-bd36-e658bf1730d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Flow 'volume_create_manager' (cd4df1ed-6ad0-4701-9680-c59d88f19980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af82ec5-a22b-4b12-9483-460631439ffe]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] snapshot: 068ae40a-299f-4d6f-816f-c5963fecb5a7, volume: 6af584d6-2094-418e-9d82-8464ff6999eb, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ca8cb7ff-7415-4b0e-9e5d-d0599dbe1592 tempest-ProjectReaderTests-1836514534 None] Created volume successfully. Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[43450d10-1178-45b0-8b6c-de24b6942020]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:03 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a Jul 09 17:25:03 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "cinder-531f3095-0288-4b3c-bcdd-d67f60ae7a60-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-531f3095-0288-4b3c-bcdd-d67f60ae7a60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:03 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:25:03 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "cinder-quobyte-531f3095-0288-4b3c-bcdd-d67f60ae7a60" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-quobyte-531f3095-0288-4b3c-bcdd-d67f60ae7a60" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f831f3-f0a9-4166-bf51-5e0e0868c1dc]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:03 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 Jul 09 17:25:03 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:04 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a" returned: 0 in 0.827s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:04 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 Jul 09 17:25:04 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:04 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 0.835s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481262f-bddd-4b86-bc5e-c0ded7a1d387]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:04 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:25:04 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:04 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60" returned: 0 in 0.817s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:04 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60 Jul 09 17:25:04 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:05 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2" returned: 0 in 0.752s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:05 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2 Jul 09 17:25:05 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:05 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:05 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb Jul 09 17:25:05 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:05 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-531f3095-0288-4b3c-bcdd-d67f60ae7a60" returned: 0 in 0.746s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-quobyte-531f3095-0288-4b3c-bcdd-d67f60ae7a60" released by "delete_volume" :: held 1.622s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Created reservations ['8afc1e23-357b-4003-89c5-95c164e4465e', 'eeb2b733-fffe-4780-8b90-364fadc2f33b', 'b7893c49-e2f7-4ff7-9a3e-6a34a6d98066', '42fc7aa3-96a0-4c56-b3d9-3cd0c60509c9'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:05 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:05 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:05 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a.1253fb09-ab3f-470d-ab18-f00e250d90d2" returned: 0 in 0.759s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=146,cinder:INSERT=59,cinder:UPDATE=198,cinder:DELETE=21 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-1253fb09-ab3f-470d-ab18-f00e250d90d2" released by "_delete_snapshot" :: held 3.416s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" released by "delete_snapshot" :: held 3.450s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Created reservations ['2fc8208a-dc22-4fc3-92fa-8b67f104d539', '0eba4010-92ae-4532-ae5f-3f64db6ab639', '81755035-ba5e-4ffd-893a-6206734d4447', '49d4b7f3-5a47-4ccb-8bb3-7ff28c01407d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Delete snapshot completed successfully. Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-96abeaf9-51d2-42a7-ac3a-5ac0fb682c2d tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-1253fb09-ab3f-470d-ab18-f00e250d90d2-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:06 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.789s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Deleted volume successfully. Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:UPDATE=186,cinder:SELECT=145,cinder:DELETE=15,cinder:INSERT=47 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d080ba54-d5b8-443c-aea7-ff5e3f4491d9 tempest-ProjectReaderTests-1836514534 None] Lock "cinder-531f3095-0288-4b3c-bcdd-d67f60ae7a60-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-e814062e-1716-4409-906d-d822a24a057a-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-e814062e-1716-4409-906d-d822a24a057a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:07 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" acquired by "delete_volume" :: waited 0.072s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:07 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a193650-9015-4cf7-82d5-fc43684f1d88]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:07 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a Jul 09 17:25:07 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:08 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a" returned: 0 in 1.527s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:08 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a Jul 09 17:25:08 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:10 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e814062e-1716-4409-906d-d822a24a057a" returned: 0 in 1.654s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-e814062e-1716-4409-906d-d822a24a057a" released by "delete_volume" :: held 3.356s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Created reservations ['75f12b2c-c7e2-4f36-b00f-818c784c7971', 'ac5852f8-a822-4306-9bd6-40f43545c8e4', '5f583da1-ea2c-492f-8f69-b6c2b91e7de9', '30b4918a-19a2-406a-8c07-ad6ac29fc446'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:10 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:10 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:11 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb" returned: 0 in 5.858s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3085cd-2fa9-4b17-a727-ab268bd9ab04]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:11 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:25:11 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-3b4a48aa-7096-4633-8bef-89befa1a9eb7-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:11 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.856s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Deleted volume successfully. Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-3b4a48aa-7096-4633-8bef-89befa1a9eb7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-51360307-eeae-4b52-a53a-aae7310b7e2f tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-e814062e-1716-4409-906d-d822a24a057a-delete_volume" released by "delete_volume" :: held 4.615s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "cinder-quobyte-3b4a48aa-7096-4633-8bef-89befa1a9eb7" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-3b4a48aa-7096-4633-8bef-89befa1a9eb7" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd56a5a-dd72-4cff-9ca5-8d4f96903438]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:11 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 Jul 09 17:25:11 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:12 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.983s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:25:12 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Converted 1024.00 MB image at 174.77 MB/s Jul 09 17:25:12 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb is being set with open permissions: ugo+rw Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:12 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb Jul 09 17:25:12 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:12 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7" returned: 0 in 0.799s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:12 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7 Jul 09 17:25:12 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:12 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb" returned: 0 in 0.706s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" released by "_copy_volume_from_snapshot" :: held 9.351s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7-6af584d6-2094-418e-9d82-8464ff6999eb" released by "_create_volume_from_snapshot" :: held 9.432s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.508s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.458s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926825615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:03Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume 94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:12 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:12 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef 1073741824 Jul 09 17:25:12 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:12 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (d96ce152-1302-47a8-aaf2-5c5598b9da49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12826ff-bb21-4c81-9a37-fb5338478fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f37656b-f902-4265-a151-e01961fb861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af584d6-2094-418e-9d82-8464ff6999eb', 'volume_size': 1, 'snapshot_id': '068ae40a-299f-4d6f-816f-c5963fecb5a7'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a19146-7eba-44cf-906e-e21d832081cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12826ff-bb21-4c81-9a37-fb5338478fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873461195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0426ce1-7fcf-4778-9dbc-c981218cb457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:13Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b8b04e-0596-46b5-8246-2b5911c26cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b8b04e-0596-46b5-8246-2b5911c26cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e864ef-6d2d-4d23-b825-d7ff1bed1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e864ef-6d2d-4d23-b825-d7ff1bed1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0426ce1-7fcf-4778-9dbc-c981218cb457', 'volume_name': 'volume-b0426ce1-7fcf-4778-9dbc-c981218cb457', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cf32da-1493-4a6c-bdb7-1ae1770d7bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cf32da-1493-4a6c-bdb7-1ae1770d7bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf47f7d-0138-4c1b-8a8e-05e749d625a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Volume b0426ce1-7fcf-4778-9dbc-c981218cb457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0426ce1-7fcf-4778-9dbc-c981218cb457', 'volume_size': 1} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:13 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Volume volume-6af584d6-2094-418e-9d82-8464ff6999eb (6af584d6-2094-418e-9d82-8464ff6999eb): created successfully Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a19146-7eba-44cf-906e-e21d832081cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Flow 'volume_create_manager' (5158c78a-45af-4d57-a705-094ebab08790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3b4a48aa-7096-4633-8bef-89befa1a9eb7" returned: 0 in 0.741s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-quobyte-3b4a48aa-7096-4633-8bef-89befa1a9eb7" released by "delete_volume" :: held 1.589s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:13 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a3189ea8-9839-4abf-adf7-40e7fcee3801 tempest-VolumeDependencyTests-1394256140 None] Created volume successfully. Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Created reservations ['ad4422ed-a9ef-4f47-8905-a7e9637eff48', 'a2487a76-327e-46e5-93d1-90583b8ccf94', '440933b0-64e3-4fcd-9e52-6a48a4113da0', 'f26ced5b-5cf2-4a30-8e25-5f651dade247'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:13 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:13 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-068ae40a-299f-4d6f-816f-c5963fecb5a7-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-068ae40a-299f-4d6f-816f-c5963fecb5a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Deleting offline snapshot 068ae40a-299f-4d6f-816f-c5963fecb5a7 of volume 3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] snapshot_file for this snap is: volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd138d-51de-4bb6-89be-58618ccdb260]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:13 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:25:13 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:14 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.722s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:14 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Deleted volume successfully. Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef 1073741824" returned: 0 in 1.098s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7ee6d09d-6704-4f75-baf1-036fbd6367eb tempest-CinderUnicodeTest-1664467279 None] Lock "cinder-3b4a48aa-7096-4633-8bef-89befa1a9eb7-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:14 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef Jul 09 17:25:14 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:14 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 0.912s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d25d9-ff6a-4525-824c-7da740c05d2e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:14 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:25:14 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:14 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" returned: 0 in 0.693s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873461195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0426ce1-7fcf-4778-9dbc-c981218cb457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:13Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Creating volume b0426ce1-7fcf-4778-9dbc-c981218cb457 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:14 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec722c-2c2d-44d9-9cb0-369e482f4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d71705-8273-4676-af82-a6a53d44d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:14 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 1073741824 Jul 09 17:25:14 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:14 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef (94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef): created successfully Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d71705-8273-4676-af82-a6a53d44d14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:14 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (ab97f6cc-c7d8-4230-94a8-de7c545f56ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4c82cc0d-6c4c-4fb3-8a8f-3d65b84b632e tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:15 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:15 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:25:15 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:15 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 1073741824" returned: 0 in 1.064s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:15 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 Jul 09 17:25:15 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:15 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (595caac8-1a29-49e8-93f4-937da4b1c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac714e3-f693-4f35-a85a-9aea5957f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac714e3-f693-4f35-a85a-9aea5957f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164767785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991526b9-e081-4691-92d5-d8e4875a64a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:16Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bc2500-2a54-4cde-b4c7-39733b5bf4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bc2500-2a54-4cde-b4c7-39733b5bf4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612467c0-8acb-4333-aa24-3f4e8e1aa4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612467c0-8acb-4333-aa24-3f4e8e1aa4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991526b9-e081-4691-92d5-d8e4875a64a3', 'volume_name': 'volume-991526b9-e081-4691-92d5-d8e4875a64a3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2140776-d3a8-40d6-8fe0-7eafab642d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2140776-d3a8-40d6-8fe0-7eafab642d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab9e910-bd9d-4367-9004-ad5b2b91462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume 991526b9-e081-4691-92d5-d8e4875a64a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991526b9-e081-4691-92d5-d8e4875a64a3', 'volume_size': 1} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (e0836adf-0a8f-4940-bd13-28bef0473cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e80462-cf53-4c63-8c12-5dcd4850370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 1.151s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e80462-cf53-4c63-8c12-5dcd4850370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644914765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979de61d-2f2a-4dd4-8128-cb7e301d6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:16Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41096385-ea2b-4485-b495-552e7e94f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7 Jul 09 17:25:16 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41096385-ea2b-4485-b495-552e7e94f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4964b249-fc98-4e1c-b21d-14b3a2a770ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4964b249-fc98-4e1c-b21d-14b3a2a770ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979de61d-2f2a-4dd4-8128-cb7e301d6c5e', 'volume_name': 'volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18135aa-249d-43bf-b392-a65e3eefc122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18135aa-249d-43bf-b392-a65e3eefc122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e7b964-e111-4a58-aecc-894a53c40648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:16 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume 979de61d-2f2a-4dd4-8128-cb7e301d6c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e', 'volume_size': 1} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:16 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457" returned: 0 in 0.890s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164767785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991526b9-e081-4691-92d5-d8e4875a64a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:16Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume 991526b9-e081-4691-92d5-d8e4875a64a3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:16 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:16 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 1073741824 Jul 09 17:25:16 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf47f7d-0138-4c1b-8a8e-05e749d625a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0426ce1-7fcf-4778-9dbc-c981218cb457', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:16 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5b030e-ff19-4c96-bed1-0e52d9c68093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Volume volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 (b0426ce1-7fcf-4778-9dbc-c981218cb457): created successfully Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5b030e-ff19-4c96-bed1-0e52d9c68093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (d96ce152-1302-47a8-aaf2-5c5598b9da49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fc34126b-e6e5-4ef2-8c48-9b56da8f0546 tempest-ProjectReaderTests-965934404 None] Created volume successfully. Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (2e97272a-b6da-47d5-8830-cd75d9a79ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9cd7d1-24fa-44aa-8c23-049631d0ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9cd7d1-24fa-44aa-8c23-049631d0ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1188696020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240af6d3-d814-41a8-bca0-04a45fd7f4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:17Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd35b79b-e4b0-4136-a8be-ffcbc16f5383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd35b79b-e4b0-4136-a8be-ffcbc16f5383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599e2ebf-0b1b-418c-90b7-5eca7894c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599e2ebf-0b1b-418c-90b7-5eca7894c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240af6d3-d814-41a8-bca0-04a45fd7f4cb', 'volume_name': 'volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06caf106-a839-41a9-ab8c-fac171037770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06caf106-a839-41a9-ab8c-fac171037770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47aac9-4086-4cd1-a32f-f71fab4658e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume 240af6d3-d814-41a8-bca0-04a45fd7f4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb', 'volume_size': 1} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:17 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97.068ae40a-299f-4d6f-816f-c5963fecb5a7" returned: 0 in 0.885s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-068ae40a-299f-4d6f-816f-c5963fecb5a7" released by "_delete_snapshot" :: held 3.978s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" released by "delete_snapshot" :: held 4.009s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (ad8fced0-a3c5-491d-97de-54400b72b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a9f208-1b8c-4aed-8631-c055c46dac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a9f208-1b8c-4aed-8631-c055c46dac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194613954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d083a394-ec9d-4184-82d6-160190eda08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:18Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75fd3ab-d139-477f-9462-00a090d64478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75fd3ab-d139-477f-9462-00a090d64478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9adf10e-f459-4b87-9568-94b7cd0f8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9adf10e-f459-4b87-9568-94b7cd0f8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd083a394-ec9d-4184-82d6-160190eda08d', 'volume_name': 'volume-d083a394-ec9d-4184-82d6-160190eda08d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cddd3c6-fbca-49b9-aa8b-86c4cb609acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cddd3c6-fbca-49b9-aa8b-86c4cb609acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f6042-09d9-440f-a653-2548e70e2fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume d083a394-ec9d-4184-82d6-160190eda08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d083a394-ec9d-4184-82d6-160190eda08d', 'volume_size': 1} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-b0426ce1-7fcf-4778-9dbc-c981218cb457-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "cinder-b0426ce1-7fcf-4778-9dbc-c981218cb457-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:17 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Created reservations ['f0d42d67-13bb-44c1-961d-f3d206f31cfd', '6f04524e-35a7-4cb0-93f7-fe30c587f71e', '166361ee-4246-43c4-a2b4-756f3ec894ca', 'd7e36689-7e00-4746-8aa3-af4a9ef933ec'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-quobyte-b0426ce1-7fcf-4778-9dbc-c981218cb457" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-b0426ce1-7fcf-4778-9dbc-c981218cb457" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[823420e9-410b-4810-8b69-e36994a01fc7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Delete snapshot completed successfully. Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8d964f46-9221-467d-9b37-4227b6ddf448 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-068ae40a-299f-4d6f-816f-c5963fecb5a7-delete_snapshot" released by "delete_snapshot" :: held 4.628s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:18 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 Jul 09 17:25:18 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (445ade53-7c1a-4adc-b4ad-b6d74755b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24607c1a-3a48-4871-afbc-28f9622a1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:18 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 1073741824" returned: 0 in 1.547s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24607c1a-3a48-4871-afbc-28f9622a1aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569520945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78062004-b696-47bd-a66f-55f5c9cf36f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:18Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df56fca4-7b26-4f90-9456-f823559a3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df56fca4-7b26-4f90-9456-f823559a3667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f56e5-e564-4089-b852-7faa12c70815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f56e5-e564-4089-b852-7faa12c70815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78062004-b696-47bd-a66f-55f5c9cf36f2', 'volume_name': 'volume-78062004-b696-47bd-a66f-55f5c9cf36f2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad50d87-5583-4f78-936c-0829aab7125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad50d87-5583-4f78-936c-0829aab7125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ae57b-35c3-4fa5-8b27-6f0b3a196cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume 78062004-b696-47bd-a66f-55f5c9cf36f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78062004-b696-47bd-a66f-55f5c9cf36f2', 'volume_size': 1} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:18 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 Jul 09 17:25:18 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-3f2e7d85-7475-4485-bd42-8e09f1b03c97-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-3f2e7d85-7475-4485-bd42-8e09f1b03c97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:19 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457" returned: 0 in 0.983s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ab7b4-eabc-4734-9240-3aa281469881]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:19 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457 Jul 09 17:25:19 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:19 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:25:19 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:19 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (2466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.602s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644914765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979de61d-2f2a-4dd4-8128-cb7e301d6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:16Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume 979de61d-2f2a-4dd4-8128-cb7e301d6c5e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:19 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab9e910-bd9d-4367-9004-ad5b2b91462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991526b9-e081-4691-92d5-d8e4875a64a3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0bc163-d6fd-4a45-9db3-d67f3c49bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:19 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e 1073741824 Jul 09 17:25:19 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-991526b9-e081-4691-92d5-d8e4875a64a3 (991526b9-e081-4691-92d5-d8e4875a64a3): created successfully Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0bc163-d6fd-4a45-9db3-d67f3c49bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (595caac8-1a29-49e8-93f4-937da4b1c01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-187a81c6-7e79-4b2e-9abd-43bd8301c090 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:19 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-b0426ce1-7fcf-4778-9dbc-c981218cb457" returned: 0 in 0.775s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-b0426ce1-7fcf-4778-9dbc-c981218cb457" released by "delete_volume" :: held 1.831s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:19 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Created reservations ['b7d86987-d126-4db9-ada8-9758262d3dd1', '7e8de121-3f17-4cc7-92ba-953cfca32d41', '727895f8-7150-402a-8b6a-6d867ce7883f', 'a44eb298-6947-4d85-b89e-c604ebf2c737'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:20 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:20 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:20 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 0.999s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:20 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97 Jul 09 17:25:20 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:20 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e 1073741824" returned: 0 in 1.159s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:20 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e Jul 09 17:25:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:20 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:21 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3f2e7d85-7475-4485-bd42-8e09f1b03c97" returned: 0 in 1.054s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-3f2e7d85-7475-4485-bd42-8e09f1b03c97" released by "delete_volume" :: held 2.200s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:21 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (4c597cb3-adfb-4956-8420-11c04557c020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5443390-d6b4-4477-9e47-783bea6424d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 1.350s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Deleted volume successfully. Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5443390-d6b4-4477-9e47-783bea6424d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549523366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653a0336-63aa-402a-b570-5c5a83037876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:21Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb9ae57-5562-4546-b4e1-00403da7bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb9ae57-5562-4546-b4e1-00403da7bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8d9b8b-a3f0-4bd4-bab9-f58355acd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8d9b8b-a3f0-4bd4-bab9-f58355acd532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653a0336-63aa-402a-b570-5c5a83037876', 'volume_name': 'volume-653a0336-63aa-402a-b570-5c5a83037876', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd19e770-cfed-4375-aede-3fbeb4e88f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd19e770-cfed-4375-aede-3fbeb4e88f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7413e-88ee-4dc4-b9dc-43cf8cc6c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Volume 653a0336-63aa-402a-b570-5c5a83037876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653a0336-63aa-402a-b570-5c5a83037876', 'volume_size': 1} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b88be786-c0cf-495d-b75c-c90a0e46c9a0 tempest-ProjectReaderTests-965934404 None] Lock "cinder-b0426ce1-7fcf-4778-9dbc-c981218cb457-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:21 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" returned: 0 in 0.986s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.332s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1188696020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240af6d3-d814-41a8-bca0-04a45fd7f4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:17Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume 240af6d3-d814-41a8-bca0-04a45fd7f4cb {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:21 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Created reservations ['339d0783-8afb-4342-9c63-5872fce92a07', 'c37348d6-4388-439a-a330-d8ca3fe49932', 'c9734b9d-874d-4ddb-b42e-514c9ff2771e', '29c03dc7-af23-4c9b-8c76-efb8754c9a70'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:21 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb 1073741824 Jul 09 17:25:21 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e7b964-e111-4a58-aecc-894a53c40648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66fc29c-b7e1-4ba2-a4e1-62d94d697c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:21 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e (979de61d-2f2a-4dd4-8128-cb7e301d6c5e): created successfully Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66fc29c-b7e1-4ba2-a4e1-62d94d697c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (e0836adf-0a8f-4940-bd13-28bef0473cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b08fcd2c-4b39-4a3a-bd64-6ee815b709b8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:21 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:21 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-6af584d6-2094-418e-9d82-8464ff6999eb-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-6af584d6-2094-418e-9d82-8464ff6999eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:22 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.771s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:22 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Deleted volume successfully. Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c4a14-7c23-4df8-bb16-15df2bcb868a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d87d09e4-37e5-4c9b-a4ef-d976d8d47225 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-3f2e7d85-7475-4485-bd42-8e09f1b03c97-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:22 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb Jul 09 17:25:22 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:22 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb 1073741824" returned: 0 in 1.078s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:22 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb Jul 09 17:25:22 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:23 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb" returned: 0 in 1.041s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:23 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb" returned: 0 in 0.872s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.689s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194613954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d083a394-ec9d-4184-82d6-160190eda08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:18Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume d083a394-ec9d-4184-82d6-160190eda08d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:23 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb Jul 09 17:25:23 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:23 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:23 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d 1073741824 Jul 09 17:25:23 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47aac9-4086-4cd1-a32f-f71fab4658e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9500a4-a6ee-4c28-9d30-37f78c00573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb (240af6d3-d814-41a8-bca0-04a45fd7f4cb): created successfully Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9500a4-a6ee-4c28-9d30-37f78c00573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (2e97272a-b6da-47d5-8830-cd75d9a79ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-728b0bb0-d7d9-452d-8d15-ad96509fa631 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:24 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-6af584d6-2094-418e-9d82-8464ff6999eb" returned: 0 in 0.730s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-quobyte-6af584d6-2094-418e-9d82-8464ff6999eb" released by "delete_volume" :: held 1.828s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Created reservations ['cb753a1e-d199-4c13-9bbc-27cca748c9e8', '37433c39-7a36-4204-b389-9d72bdf2d152', '6ddf997b-c917-4730-aaad-4d1f9af0a713', '886d66d4-51b6-426c-a4b7-a9c960d8577f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:24 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:24 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:24 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d 1073741824" returned: 0 in 0.979s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:24 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d Jul 09 17:25:24 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:25 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Deleted volume successfully. Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-662bd5df-d25e-42b2-b027-671dfae53504 tempest-VolumeDependencyTests-1394256140 None] Lock "cinder-6af584d6-2094-418e-9d82-8464ff6999eb-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:25 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d" returned: 0 in 0.915s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.091s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569520945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78062004-b696-47bd-a66f-55f5c9cf36f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0a81e08e3840a793eb51f7231c30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:18Z,use_quota=True,user_id='99af9d7a71c349cf8d0f01c4a906a0f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Creating volume 78062004-b696-47bd-a66f-55f5c9cf36f2 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:25 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f6042-09d9-440f-a653-2548e70e2fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d083a394-ec9d-4184-82d6-160190eda08d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:25 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 1073741824 Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bfaed6-cf0b-4e3a-950d-3f4dd55238ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:25 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:25 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-d083a394-ec9d-4184-82d6-160190eda08d (d083a394-ec9d-4184-82d6-160190eda08d): created successfully Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bfaed6-cf0b-4e3a-950d-3f4dd55238ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (ad8fced0-a3c5-491d-97de-54400b72b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-aaf850be-1425-45b6-8ea0-dd44a36a030f tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:26 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 1073741824" returned: 0 in 1.065s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:26 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 Jul 09 17:25:26 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:27 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2" returned: 0 in 0.728s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.901s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549523366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653a0336-63aa-402a-b570-5c5a83037876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:21Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Creating volume 653a0336-63aa-402a-b570-5c5a83037876 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:27 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ae57b-35c3-4fa5-8b27-6f0b3a196cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78062004-b696-47bd-a66f-55f5c9cf36f2', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2e1d06-10c6-42ac-b1be-460d9a6bce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:27 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 1073741824 Jul 09 17:25:27 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Volume volume-78062004-b696-47bd-a66f-55f5c9cf36f2 (78062004-b696-47bd-a66f-55f5c9cf36f2): created successfully Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2e1d06-10c6-42ac-b1be-460d9a6bce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Flow 'volume_create_manager' (445ade53-7c1a-4adc-b4ad-b6d74755b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-fb99ad9c-abfc-4778-b282-03f924286fa1 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created volume successfully. Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-78062004-b696-47bd-a66f-55f5c9cf36f2-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-78062004-b696-47bd-a66f-55f5c9cf36f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-78062004-b696-47bd-a66f-55f5c9cf36f2" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-78062004-b696-47bd-a66f-55f5c9cf36f2" acquired by "delete_volume" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5e8eed-d14d-40f7-b0d2-59edfe7dd293]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:28 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 1073741824" returned: 0 in 1.226s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:28 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 Jul 09 17:25:28 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:28 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 Jul 09 17:25:28 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (57012253-69d1-4129-a936-745d1977df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f45386f-2c11-4b77-bdf9-f23c5a9a00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f45386f-2c11-4b77-bdf9-f23c5a9a00bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188730343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740155ce-9c31-4e8a-b601-2819fdc1ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:29Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834ec05a-27ec-4497-afb8-ba4839773c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834ec05a-27ec-4497-afb8-ba4839773c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5df8339-cdec-4891-a00b-8730e10d0b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5df8339-cdec-4891-a00b-8730e10d0b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740155ce-9c31-4e8a-b601-2819fdc1ea5e', 'volume_name': 'volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e034f6f2-3013-48bb-bdd1-09f71c69c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e034f6f2-3013-48bb-bdd1-09f71c69c687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c53d8f5-636c-4ec1-825e-2110ff92c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Volume 740155ce-9c31-4e8a-b601-2819fdc1ea5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e', 'volume_size': 1} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:29 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876" returned: 0 in 0.880s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188730343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740155ce-9c31-4e8a-b601-2819fdc1ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:29Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Creating volume 740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:29 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:29 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e 1073741824 Jul 09 17:25:29 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7413e-88ee-4dc4-b9dc-43cf8cc6c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653a0336-63aa-402a-b570-5c5a83037876', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948d964a-3b94-470d-a2f1-4a134f85b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:29 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2" returned: 0 in 1.085s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Volume volume-653a0336-63aa-402a-b570-5c5a83037876 (653a0336-63aa-402a-b570-5c5a83037876): created successfully Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948d964a-3b94-470d-a2f1-4a134f85b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (4c597cb3-adfb-4956-8420-11c04557c020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b7ecee66-731a-4622-a21d-9e488b32bbb6 tempest-ProjectReaderTests-965934404 None] Created volume successfully. Jul 09 17:25:29 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2 Jul 09 17:25:29 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:30 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-78062004-b696-47bd-a66f-55f5c9cf36f2" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-78062004-b696-47bd-a66f-55f5c9cf36f2" released by "delete_volume" :: held 1.901s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['f1fc5a1d-26c8-488a-a421-dee62327b340', '8aad4461-f11e-4396-b539-3c7009f3698a', 'c302dc57-93f1-40c4-85df-53cf6d251679', '7e36ed43-343a-404d-af49-972d856b162d'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:30 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:30 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-d083a394-ec9d-4184-82d6-160190eda08d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-653a0336-63aa-402a-b570-5c5a83037876-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-d083a394-ec9d-4184-82d6-160190eda08d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "cinder-653a0336-63aa-402a-b570-5c5a83037876-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:30 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e 1073741824" returned: 0 in 1.258s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-quobyte-653a0336-63aa-402a-b570-5c5a83037876" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-d083a394-ec9d-4184-82d6-160190eda08d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-653a0336-63aa-402a-b570-5c5a83037876" acquired by "delete_volume" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-d083a394-ec9d-4184-82d6-160190eda08d" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e6bb3a-3c0a-4c37-b1a0-d0d125873583]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54b63d-1eae-4dc4-8d1e-cf9e72b5b045]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:31 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e Jul 09 17:25:31 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:31 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 Jul 09 17:25:31 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:31 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d Jul 09 17:25:31 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:31 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.959s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:31 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-18e3c799-48ed-40d1-86a4-0f023032c75d tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-78062004-b696-47bd-a66f-55f5c9cf36f2-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:31 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e" returned: 0 in 0.864s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c53d8f5-636c-4ec1-825e-2110ff92c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f175ab0a-20f8-40ab-ae1a-424f89771083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Volume volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e (740155ce-9c31-4e8a-b601-2819fdc1ea5e): created successfully Jul 09 17:25:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f175ab0a-20f8-40ab-ae1a-424f89771083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (57012253-69d1-4129-a936-745d1977df6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:32 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9c45af2f-d568-4d6e-8088-4061cfdc11f3 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:25:32 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876" returned: 0 in 1.017s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:32 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876 Jul 09 17:25:32 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:32 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d" returned: 0 in 1.228s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:32 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d Jul 09 17:25:32 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:32 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-653a0336-63aa-402a-b570-5c5a83037876" returned: 0 in 0.861s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:32 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-653a0336-63aa-402a-b570-5c5a83037876" released by "delete_volume" :: held 1.950s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Created reservations ['01d96767-8605-46a8-aa1a-1289beb2c4fe', '432c11d5-afe4-4070-9a14-bdc50ff32d8a', '976a2e2b-d8d6-40df-aaec-5842a792e91a', '2c9efc81-8137-40dd-9c7f-d8c559ba9b33'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:33 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:33 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:33 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d083a394-ec9d-4184-82d6-160190eda08d" returned: 0 in 0.965s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Creating offline snapshot b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 of volume 740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-d083a394-ec9d-4184-82d6-160190eda08d" released by "delete_volume" :: held 2.266s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63cfc54-9d21-4ecf-b133-629becb4ad6a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['c4f2f7b1-e0ab-4e1e-b68f-c68d49e85067', 'd1018421-9460-4928-bedb-0f1ee2941b85', '430573df-5016-4613-ad29-4b1e9fcc9ce5', 'e5137666-2cc2-4e61-aeed-51215c360a5f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:33 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e Jul 09 17:25:33 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:33 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:33 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:33 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.792s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:33 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Deleted volume successfully. Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f4539aeb-4f0e-4a4b-bf55-aa2f6ab97aa8 tempest-ProjectReaderTests-965934404 None] Lock "cinder-653a0336-63aa-402a-b570-5c5a83037876-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:34 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e" returned: 0 in 0.882s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:34 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 1G Jul 09 17:25:34 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-240af6d3-d814-41a8-bca0-04a45fd7f4cb-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:34 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.820s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-240af6d3-d814-41a8-bca0-04a45fd7f4cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e026b5c1-0af7-41df-8e67-169800980792 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-d083a394-ec9d-4184-82d6-160190eda08d-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-240af6d3-d814-41a8-bca0-04a45fd7f4cb" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-240af6d3-d814-41a8-bca0-04a45fd7f4cb" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d40c28-62a6-4d17-9180-96245517f9e3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:34 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb Jul 09 17:25:34 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (17445035-889d-4bb2-9b82-4e7601109e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c6ff1-f2a7-44ff-bb5a-82c1f5881aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c6ff1-f2a7-44ff-bb5a-82c1f5881aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177083559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b760ea4-6aff-4d66-9280-d09bb72abbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:35Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5212381-1db2-4976-aeaf-a7328d7e2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5212381-1db2-4976-aeaf-a7328d7e2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b094f27-ed51-49ad-9bec-c34ea5e94f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b094f27-ed51-49ad-9bec-c34ea5e94f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b760ea4-6aff-4d66-9280-d09bb72abbf3', 'volume_name': 'volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4278167-0b0f-4a77-9fb4-e4c52ed86f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4278167-0b0f-4a77-9fb4-e4c52ed86f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbd8061-01a9-429b-9246-cae6c21b0a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:34 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Volume 9b760ea4-6aff-4d66-9280-d09bb72abbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3', 'volume_size': 1} Jul 09 17:25:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:35 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 1G" returned: 0 in 1.122s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:35 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb" returned: 0 in 0.947s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:35 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 Jul 09 17:25:35 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:35 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb Jul 09 17:25:35 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:36 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-240af6d3-d814-41a8-bca0-04a45fd7f4cb" returned: 0 in 0.798s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:36 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:36 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 is being set with open permissions: ugo+rw Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-240af6d3-d814-41a8-bca0-04a45fd7f4cb" released by "delete_volume" :: held 1.816s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:36 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 Jul 09 17:25:36 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['f235a3b2-be7e-41e9-b4e2-cd776ec6dba6', 'b0d64956-0284-47ca-9068-821a3bc9668b', '02112847-b326-45c7-8eba-cdb7e4667285', '97372c18-0829-4e7b-b6da-54995519cd43'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:36 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:36 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-979de61d-2f2a-4dd4-8128-cb7e301d6c5e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-979de61d-2f2a-4dd4-8128-cb7e301d6c5e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350bfaa-67c7-48c8-a87c-bad6244a6145]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:37 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" returned: 0 in 0.924s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:37 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e Jul 09 17:25:37 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:37 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info Jul 09 17:25:37 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:37 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.852s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a59f24b2-be71-4181-94cd-e8495cc56ecb tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-240af6d3-d814-41a8-bca0-04a45fd7f4cb-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:37 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" returned: 0 in 0.915s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:37 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e Jul 09 17:25:37 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:37 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info" returned: 0 in 0.775s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:37 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info is being set with open permissions: ugo+rw Jul 09 17:25:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:37 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info Jul 09 17:25:37 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:38 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" returned: 0 in 0.682s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-979de61d-2f2a-4dd4-8128-cb7e301d6c5e" released by "delete_volume" :: held 1.669s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['70578959-a663-415e-8ea0-7ef3618dc0c8', 'f04c7d3b-56a7-4343-a8a6-7a8bf15471ee', '18a070ba-cc7d-4c73-929c-3ad289573fa5', '52b5055e-5e52-452c-854f-78d16768c6e5'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:38 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.info" returned: 0 in 0.747s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.470s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.760s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177083559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b760ea4-6aff-4d66-9280-d09bb72abbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:35Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Creating volume 9b760ea4-6aff-4d66-9280-d09bb72abbf3 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:38 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:38 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 1073741824 Jul 09 17:25:38 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d38b2bc8-ac92-43a7-9cb0-e927a712cf7b tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:38 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:38 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-991526b9-e081-4691-92d5-d8e4875a64a3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-991526b9-e081-4691-92d5-d8e4875a64a3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-991526b9-e081-4691-92d5-d8e4875a64a3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-991526b9-e081-4691-92d5-d8e4875a64a3" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae7a0e-dc52-4aa4-a651-62c79b848fc6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:39 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 Jul 09 17:25:39 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:39 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.800s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7150139a-ee3a-4275-b033-5091c1fb82dd tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-979de61d-2f2a-4dd4-8128-cb7e301d6c5e-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 of volume 740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c2051-7d01-47de-b6fd-a7e91a137e49]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:39 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 1073741824" returned: 0 in 1.127s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:39 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 Jul 09 17:25:39 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:39 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 Jul 09 17:25:39 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:40 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3" returned: 0 in 1.066s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:40 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3 Jul 09 17:25:40 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:40 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3" returned: 0 in 0.835s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbd8061-01a9-429b-9246-cae6c21b0a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7904aeaf-208a-4b75-a08a-21502aca8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Volume volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 (9b760ea4-6aff-4d66-9280-d09bb72abbf3): created successfully Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7904aeaf-208a-4b75-a08a-21502aca8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:40 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (17445035-889d-4bb2-9b82-4e7601109e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" returned: 0 in 1.009s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:25:40 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-dc90fdda-cc29-4a58-a2d1-273fc4a61b38 tempest-ProjectReaderTests-965934404 None] Created volume successfully. Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1750a18-ffa0-493c-abee-906d5e8f125b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:40 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e Jul 09 17:25:40 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:41 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-991526b9-e081-4691-92d5-d8e4875a64a3" returned: 0 in 0.819s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-991526b9-e081-4691-92d5-d8e4875a64a3" released by "delete_volume" :: held 1.956s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['76047b2d-814e-4d1f-9c62-1c3c0f94127f', '3ae2b7b0-6059-4d95-821e-b12a706cfb8c', '795c6775-209b-4ee2-8ea0-904d823e7dca', 'a110df3b-bf7e-493a-be8a-cf2697bdb9a0'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:41 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:41 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-9b760ea4-6aff-4d66-9280-d09bb72abbf3-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "cinder-quobyte-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "cinder-9b760ea4-6aff-4d66-9280-d09bb72abbf3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125abd5-f5e6-4616-a9ef-ac2317b4792a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-quobyte-9b760ea4-6aff-4d66-9280-d09bb72abbf3" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:41 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e" returned: 0 in 0.987s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-9b760ea4-6aff-4d66-9280-d09bb72abbf3" acquired by "delete_volume" :: waited 0.044s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:41 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 Jul 09 17:25:41 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e93c9b7-8f3a-40e1-858c-5473fab1e35d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:41 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef Jul 09 17:25:41 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:42 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 Jul 09 17:25:42 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:42 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.823s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-2be2532c-f14d-4d55-93c5-7d3e2a8e1ff8 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-991526b9-e081-4691-92d5-d8e4875a64a3-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:42 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3" returned: 0 in 0.925s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:42 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3 Jul 09 17:25:42 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:42 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" returned: 0 in 1.066s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:42 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7 Jul 09 17:25:42 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:42 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" returned: 0 in 1.241s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:42 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef Jul 09 17:25:42 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:43 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9b760ea4-6aff-4d66-9280-d09bb72abbf3" returned: 0 in 0.785s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-9b760ea4-6aff-4d66-9280-d09bb72abbf3" released by "delete_volume" :: held 1.766s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Created reservations ['57a865eb-177e-496f-86ae-f097125d8a6d', '78d7e50a-11f2-4ba5-964d-6927209c0ee8', '9aa965cb-05c8-4329-8610-223b5f2e37d6', 'dccea62e-538d-4bd5-9569-046a98bd5256'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:43 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e.b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" returned: 0 in 0.924s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:43 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:43 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:43 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" returned: 0 in 0.901s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7" released by "_delete_snapshot" :: held 4.157s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-quobyte-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef" released by "delete_volume" :: held 2.268s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" released by "delete_snapshot" :: held 4.203s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Created reservations ['0a3f36b4-dfd4-40f1-86c4-e85b512a0a5d', 'f86dbd5a-e65e-4b3e-affa-b91a607ac545', '31da21ce-5593-42c1-9ada-3cbdf31afdb4', '33e8d3a4-cae9-43b9-b6f8-ee5cf1d6bcde'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Created reservations ['b71007ec-6828-4c2c-946e-11e954baf11e', '09fabbb9-9948-452a-a35f-dca899a7eaeb', 'a460ac33-a606-4047-b29f-ff4b767b4ba4', '6c618230-9037-450f-a971-a13a7f9abd3f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a2a503bd-98a4-4afa-ba65-810c8e9d311b tempest-ProjectMemberTests-336346371 None] Lock "cinder-b00d7b7a-7319-4b1b-9c69-8cbff4dd54d7-delete_snapshot" released by "delete_snapshot" :: held 4.481s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:44 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:44 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:44 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.822s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Deleted volume successfully. Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (7de19dbb-834a-4c9e-babf-d371af4a7726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f4ca16-e14a-4e22-aad8-441910e2e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f4ca16-e14a-4e22-aad8-441910e2e011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818046219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77093604-000e-4eef-a89c-259bbd73e45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:45Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc213aec-25bb-4cbd-8a99-1e4214965b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc213aec-25bb-4cbd-8a99-1e4214965b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee3afbf-e24e-4a77-ac3d-7f39d860a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee3afbf-e24e-4a77-ac3d-7f39d860a03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77093604-000e-4eef-a89c-259bbd73e45f', 'volume_name': 'volume-77093604-000e-4eef-a89c-259bbd73e45f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb4d438-b91c-4ed8-adf1-e765f4151ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb4d438-b91c-4ed8-adf1-e765f4151ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869e86a-40d9-49f1-924f-3d6e39d709aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:44 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Volume 77093604-000e-4eef-a89c-259bbd73e45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77093604-000e-4eef-a89c-259bbd73e45f', 'volume_size': 1} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818046219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77093604-000e-4eef-a89c-259bbd73e45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee4ffd2b94549e598c2adc0b65574d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:45Z,use_quota=True,user_id='e12cd45078ab4e1980b60fc1c1f56201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Creating volume 77093604-000e-4eef-a89c-259bbd73e45f {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:44 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-344b6b2a-41f4-4d84-8037-a332dd8e9556 tempest-ProjectReaderTests-965934404 None] Lock "cinder-9b760ea4-6aff-4d66-9280-d09bb72abbf3-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:44 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f 1073741824 Jul 09 17:25:44 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:44 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-740155ce-9c31-4e8a-b601-2819fdc1ea5e-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.891s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:45 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Deleted volume successfully. Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "cinder-740155ce-9c31-4e8a-b601-2819fdc1ea5e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-8375b22e-f8f0-4b47-9d2f-91116f9cc0c6 tempest-CreateVolumesFromSourceVolumeTest-609847211 None] Lock "cinder-94d45b0f-9630-4bf9-b9b6-1e63cff6f9ef-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" acquired by "delete_volume" :: waited 0.022s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e3c4d4-c3ed-41bd-b5c3-12daa0a01b35]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:45 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e Jul 09 17:25:45 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Flow 'volume_create_manager' (40366e4b-98cd-42ea-8b4c-3625e09b5ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a35bf0a-4186-4794-88ab-8fa7fe7eca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a35bf0a-4186-4794-88ab-8fa7fe7eca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-358674988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29520064-bea0-4951-8cfb-c8f7384b0cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590ae9dab45147abb1ab81927bc57f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:46Z,use_quota=True,user_id='7f6d84d3afd043f8b3c1f972124e7ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac23d-54b0-4109-9dd5-4b71046a0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac23d-54b0-4109-9dd5-4b71046a0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bbaf2a-c5cc-4bd8-9247-776fd898c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bbaf2a-c5cc-4bd8-9247-776fd898c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29520064-bea0-4951-8cfb-c8f7384b0cff', 'volume_name': 'volume-29520064-bea0-4951-8cfb-c8f7384b0cff', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440172f0-861d-47a1-ac70-5bf8f2a1f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440172f0-861d-47a1-ac70-5bf8f2a1f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0c6f08-cdca-4ea9-901f-124e32173d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:45 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Volume 29520064-bea0-4951-8cfb-c8f7384b0cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29520064-bea0-4951-8cfb-c8f7384b0cff', 'volume_size': 1} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:45 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f 1073741824" returned: 0 in 1.165s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:45 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f Jul 09 17:25:45 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:46 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e" returned: 0 in 1.062s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:46 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e Jul 09 17:25:46 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:46 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f" returned: 0 in 0.743s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-358674988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29520064-bea0-4951-8cfb-c8f7384b0cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590ae9dab45147abb1ab81927bc57f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:46Z,use_quota=True,user_id='7f6d84d3afd043f8b3c1f972124e7ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Creating volume 29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:46 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:46 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff 1073741824 Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869e86a-40d9-49f1-924f-3d6e39d709aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77093604-000e-4eef-a89c-259bbd73e45f', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:46 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b680a5a-c8b0-4bf6-b1c5-0bbbb570ae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:46 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Volume volume-77093604-000e-4eef-a89c-259bbd73e45f (77093604-000e-4eef-a89c-259bbd73e45f): created successfully Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b680a5a-c8b0-4bf6-b1c5-0bbbb570ae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Flow 'volume_create_manager' (7de19dbb-834a-4c9e-babf-d371af4a7726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d57d332c-d215-4364-bfb4-49c00d544c48 tempest-ProjectReaderTests-965934404 None] Created volume successfully. Jul 09 17:25:46 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-740155ce-9c31-4e8a-b601-2819fdc1ea5e" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-740155ce-9c31-4e8a-b601-2819fdc1ea5e" released by "delete_volume" :: held 1.843s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Created reservations ['cccd1daa-a7b9-495b-844d-15d1a0a29991', 'bf657440-80dd-4d8f-8b2b-7529289ba4a4', '9ef1157f-351f-410f-9602-f5dda951538e', '3e2c3ce2-356a-4f3c-9432-e546b1721a01'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:47 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:47 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:47 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff 1073741824" returned: 0 in 1.026s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:47 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:25:47 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-77093604-000e-4eef-a89c-259bbd73e45f-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "cinder-77093604-000e-4eef-a89c-259bbd73e45f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (dfa7fa91-a537-4aea-8854-3c88dbbf4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d987d33b-88a2-48a6-8548-485e57912c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d987d33b-88a2-48a6-8548-485e57912c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187277384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e556dbcb-b413-4d60-8a32-369f9d522a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:48Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b731b3f-21d0-4afb-b6ae-00dca27f8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b731b3f-21d0-4afb-b6ae-00dca27f8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ab59a-dfbf-4b98-938b-b78473f01a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ab59a-dfbf-4b98-938b-b78473f01a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e556dbcb-b413-4d60-8a32-369f9d522a56', 'volume_name': 'volume-e556dbcb-b413-4d60-8a32-369f9d522a56', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8c0fc8-a1aa-4d78-95ac-2f71b14cbe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8c0fc8-a1aa-4d78-95ac-2f71b14cbe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23801327-af2d-433e-b77f-21729e6a0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Volume e556dbcb-b413-4d60-8a32-369f9d522a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e556dbcb-b413-4d60-8a32-369f9d522a56', 'volume_size': 1} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.977s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Acquiring lock "cinder-quobyte-77093604-000e-4eef-a89c-259bbd73e45f" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-77093604-000e-4eef-a89c-259bbd73e45f" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-de966654-047e-43de-a991-58f395d53d05 tempest-ProjectMemberTests-336346371 None] Lock "cinder-740155ce-9c31-4e8a-b601-2819fdc1ea5e-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e4832-7b2b-437e-83f4-1e925364abe0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:48 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f Jul 09 17:25:48 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:48 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 0.869s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187277384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e556dbcb-b413-4d60-8a32-369f9d522a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:48Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Creating volume e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:48 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:48 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 1073741824 Jul 09 17:25:48 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0c6f08-cdca-4ea9-901f-124e32173d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29520064-bea0-4951-8cfb-c8f7384b0cff', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623364f-bf91-40d4-b0fd-91158321567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:48 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Volume volume-29520064-bea0-4951-8cfb-c8f7384b0cff (29520064-bea0-4951-8cfb-c8f7384b0cff): created successfully Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623364f-bf91-40d4-b0fd-91158321567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:48 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Flow 'volume_create_manager' (40366e4b-98cd-42ea-8b4c-3625e09b5ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3ac861c7-8165-429c-83fa-077845aae7e1 tempest-SnapshotDependencyTests-1594636114 None] Created volume successfully. Jul 09 17:25:49 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f" returned: 0 in 1.087s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:49 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f Jul 09 17:25:49 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0c8ebc04-2695-4f32-84aa-b7e41138ed82 tempest-ProjectAdminTests-1823078499 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7536811828613, 'free_capacity_gb': 1775.7536811828613, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86876) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 17:25:49 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 1073741824" returned: 0 in 0.900s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:49 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 Jul 09 17:25:49 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:49 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-77093604-000e-4eef-a89c-259bbd73e45f" returned: 0 in 0.675s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "cinder-quobyte-77093604-000e-4eef-a89c-259bbd73e45f" released by "delete_volume" :: held 1.830s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Created reservations ['9f4e66fd-c0bf-4208-9915-911d87bf324a', 'cef9b6ff-aeee-45d1-97c4-a2d4f93ac097', 'd1754ca5-6f3f-444b-b814-99689ba23b51', 'ee342f9a-10dd-4339-a1b1-c4f97da581f7'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:50 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:25:50 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:50 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56" returned: 0 in 0.662s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.972s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23801327-af2d-433e-b77f-21729e6a0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e556dbcb-b413-4d60-8a32-369f9d522a56', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5841c05b-d531-4494-9e0d-85000f9d5258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Creating offline snapshot e4be8432-c792-4afc-b347-c144ae441004 of volume 29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:25:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Volume volume-e556dbcb-b413-4d60-8a32-369f9d522a56 (e556dbcb-b413-4d60-8a32-369f9d522a56): created successfully Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5841c05b-d531-4494-9e0d-85000f9d5258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (dfa7fa91-a537-4aea-8854-3c88dbbf4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dcb7e2-4299-4b9a-bb27-4e9df88ebb49]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-4e5096ff-254f-4fb1-b4f0-d31ed58e67c5 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:25:50 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:25:50 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:50 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.732s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:25:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Deleted volume successfully. Jul 09 17:25:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-81e0cb1a-fd5e-407e-9221-ff63041838da tempest-ProjectReaderTests-965934404 None] Lock "cinder-77093604-000e-4eef-a89c-259bbd73e45f-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:25:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:51 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 1.078s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:51 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 1G Jul 09 17:25:51 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:52 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 1G" returned: 0 in 0.988s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29520064-bea0-4951-8cfb-c8f7384b0cff -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:52 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29520064-bea0-4951-8cfb-c8f7384b0cff -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:25:52 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:53 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29520064-bea0-4951-8cfb-c8f7384b0cff -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.698s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:53 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 is being set with open permissions: ugo+rw Jul 09 17:25:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:53 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:25:53 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:53 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.641s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:53 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info Jul 09 17:25:53 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:54 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info" returned: 0 in 0.624s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:54 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info is being set with open permissions: ugo+rw Jul 09 17:25:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:54 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info Jul 09 17:25:54 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:55 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.info" returned: 0 in 0.664s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.847s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.840s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Creating offline snapshot 5bc8799e-5e8d-411a-9e02-4e6019a58c9f of volume e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6523b-feca-4c05-9359-b01b49b9b955]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6b24fe42-a3a8-4179-ae15-264786b3bb21 tempest-SnapshotDependencyTests-1594636114 None] Create snapshot completed successfully Jul 09 17:25:55 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 Jul 09 17:25:55 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:55 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56" returned: 0 in 0.825s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:56 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f 1G Jul 09 17:25:56 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Flow 'volume_create_manager' (a902998f-6f39-45c9-bbdf-0363b79d7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0558f1d9-a85a-4e79-9f90-b3dd2e000e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0558f1d9-a85a-4e79-9f90-b3dd2e000e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674fad54-bdd0-45d8-b2c1-eece5500cc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590ae9dab45147abb1ab81927bc57f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4be8432-c792-4afc-b347-c144ae441004,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:25:56Z,use_quota=True,user_id='7f6d84d3afd043f8b3c1f972124e7ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c211e88-4172-4c20-9413-6e3057791802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c211e88-4172-4c20-9413-6e3057791802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d1c5c-28d4-4193-9f91-709a78dfbf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d1c5c-28d4-4193-9f91-709a78dfbf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '674fad54-bdd0-45d8-b2c1-eece5500cc9a', 'volume_name': 'volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a', 'volume_size': 1, 'snapshot_id': 'e4be8432-c792-4afc-b347-c144ae441004'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb3b6fa-297e-4b42-b42b-c10119e08286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb3b6fa-297e-4b42-b42b-c10119e08286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d29572-be2f-4289-b7e9-e7cb03572fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:25:56 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Volume 674fad54-bdd0-45d8-b2c1-eece5500cc9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a', 'volume_size': 1, 'snapshot_id': 'e4be8432-c792-4afc-b347-c144ae441004'} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:56 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f 1G" returned: 0 in 0.920s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e556dbcb-b413-4d60-8a32-369f9d522a56 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:56 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e556dbcb-b413-4d60-8a32-369f9d522a56 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f Jul 09 17:25:56 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:57 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e556dbcb-b413-4d60-8a32-369f9d522a56 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f" returned: 0 in 0.700s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:57 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f is being set with open permissions: ugo+rw Jul 09 17:25:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:57 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f Jul 09 17:25:57 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:58 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f" returned: 0 in 0.643s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:58 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info Jul 09 17:25:58 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:58 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info" returned: 0 in 0.692s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:58 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info is being set with open permissions: ugo+rw Jul 09 17:25:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:59 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info Jul 09 17:25:59 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:25:59 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.info" returned: 0 in 0.630s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.507s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.262s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004-674fad54-bdd0-45d8-b2c1-eece5500cc9a" by "_create_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004-674fad54-bdd0-45d8-b2c1-eece5500cc9a" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Creating volume 674fad54-bdd0-45d8-b2c1-eece5500cc9a from snapshot e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" by "_copy_volume_from_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:25:59 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f32b3c8c-69a2-40c0-839f-a1418d631d5e tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] snapshot: e4be8432-c792-4afc-b347-c144ae441004, volume: 674fad54-bdd0-45d8-b2c1-eece5500cc9a, {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f538ce-7c46-41c5-a081-05fa40082d5b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:25:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:25:59 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:25:59 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:00 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.766s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29520064-bea0-4951-8cfb-c8f7384b0cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Creating direct copy from snapshot {{(pid=86876) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79b33a9-508a-4fc9-a2aa-3dfc714ae26c]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:00 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:00 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:00 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:26:00 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-5bc8799e-5e8d-411a-9e02-4e6019a58c9f-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-5bc8799e-5e8d-411a-9e02-4e6019a58c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-5bc8799e-5e8d-411a-9e02-4e6019a58c9f" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-5bc8799e-5e8d-411a-9e02-4e6019a58c9f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot 5bc8799e-5e8d-411a-9e02-4e6019a58c9f of volume e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f4e4e2-c41f-49ce-8397-c662753b8206]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:00 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f Jul 09 17:26:00 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:01 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:26:01 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 0.874s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG cinder.utils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Path /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a not found in is_blk_device check {{(pid=86876) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:01 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a Jul 09 17:26:01 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:01 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f" returned: 0 in 0.758s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e556dbcb-b413-4d60-8a32-369f9d522a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c44d5e8-9f85-405e-8c0b-c61d553b8622]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:01 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 Jul 09 17:26:01 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:02 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56" returned: 0 in 1.040s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:02 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f Jul 09 17:26:02 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:04 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f" returned: 0 in 1.634s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:04 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f Jul 09 17:26:04 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:05 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56.5bc8799e-5e8d-411a-9e02-4e6019a58c9f" returned: 0 in 1.362s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-5bc8799e-5e8d-411a-9e02-4e6019a58c9f" released by "_delete_snapshot" :: held 5.016s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:05 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" released by "delete_snapshot" :: held 5.066s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:05 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Created reservations ['b2e33278-4783-42ac-b6c6-30139fd75a0f', '52878f5b-0483-4d36-ac5b-fa2be365ed31', 'cce6ac96-4fd9-42d1-9598-904f6a53112b', 'b3ceb016-845d-43d6-b8f1-178b284a14e1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=130,cinder:INSERT=45,cinder:UPDATE=176,cinder:DELETE=15 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:26:06 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a6d423bd-b53b-491a-ac29-6462299f43a5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-5bc8799e-5e8d-411a-9e02-4e6019a58c9f-delete_snapshot" released by "delete_snapshot" :: held 5.502s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-e556dbcb-b413-4d60-8a32-369f9d522a56-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "cinder-e556dbcb-b413-4d60-8a32-369f9d522a56-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=131,cinder:INSERT=45,cinder:UPDATE=192,cinder:DELETE=17 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" acquired by "delete_volume" :: waited 0.054s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[389781c6-0081-459b-a471-8e4f473d52ac]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:06 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a" returned: 0 in 5.576s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e6e0c5-3051-4915-afb1-9eeafbf4685a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:06 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 Jul 09 17:26:06 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:07 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:26:07 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:07 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56" returned: 0 in 0.790s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:07 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56 Jul 09 17:26:07 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:07 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 1.015s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:07 devstack cinder-volume[86876]: DEBUG cinder.image.image_utils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Image conversion details: src /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a {{(pid=86876) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 17:26:07 devstack cinder-volume[86876]: INFO cinder.image.image_utils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Converted 1024.00 MB image at 183.61 MB/s Jul 09 17:26:07 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a is being set with open permissions: ugo+rw Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:08 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a Jul 09 17:26:08 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:08 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-e556dbcb-b413-4d60-8a32-369f9d522a56" returned: 0 in 0.801s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e556dbcb-b413-4d60-8a32-369f9d522a56" released by "delete_volume" :: held 1.667s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Created reservations ['a765744e-ddff-4059-99c6-13357b87f695', 'aae7716c-7455-421b-82a5-f0e2e6ac2c7d', '24cdb8ed-bc87-4a5a-a8ab-787c7cec4739', '4392ba85-001f-4f08-ac0f-aa7a14aa1164'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:08 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:08 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:08 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" released by "_copy_volume_from_snapshot" :: held 8.982s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004-674fad54-bdd0-45d8-b2c1-eece5500cc9a" released by "_create_volume_from_snapshot" :: held 9.017s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.042s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d29572-be2f-4289-b7e9-e7cb03572fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a', 'volume_size': 1, 'snapshot_id': 'e4be8432-c792-4afc-b347-c144ae441004'}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758cf9a-13fd-4276-a268-48cee3544c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:08 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Volume volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a (674fad54-bdd0-45d8-b2c1-eece5500cc9a): created successfully Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758cf9a-13fd-4276-a268-48cee3544c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:08 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Flow 'volume_create_manager' (a902998f-6f39-45c9-bbdf-0363b79d7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d2f47427-9a14-4fd2-8982-68b7367498d8 tempest-SnapshotDependencyTests-1594636114 None] Created volume successfully. Jul 09 17:26:09 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:09 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (2129b9dd-75a0-4469-9539-1a7eff6fab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2327e422-aee4-4394-bf77-a89af9fe3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7c916d16-173e-4114-8958-16f9a18fb296 tempest-ProjectMemberTests-336346371 None] Lock "cinder-e556dbcb-b413-4d60-8a32-369f9d522a56-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2327e422-aee4-4394-bf77-a89af9fe3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123743226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99ad0b8-15dd-4297-996a-a4c46fd7abe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:09Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c384eae2-85e4-410c-89e2-8f166d3cda6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c384eae2-85e4-410c-89e2-8f166d3cda6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5c328b-c285-46c2-b2bf-e452ca154da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5c328b-c285-46c2-b2bf-e452ca154da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99ad0b8-15dd-4297-996a-a4c46fd7abe5', 'volume_name': 'volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08acf559-7944-4f32-8a5c-dd7137e1cc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08acf559-7944-4f32-8a5c-dd7137e1cc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f842ad-1e33-4ec8-9fdb-9019222b7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:09 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Volume c99ad0b8-15dd-4297-996a-a4c46fd7abe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5', 'volume_size': 1} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123743226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99ad0b8-15dd-4297-996a-a4c46fd7abe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:09Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Creating volume c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:26:09 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:09 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 1073741824 Jul 09 17:26:09 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-e4be8432-c792-4afc-b347-c144ae441004-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-e4be8432-c792-4afc-b347-c144ae441004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Deleting offline snapshot e4be8432-c792-4afc-b347-c144ae441004 of volume 29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] snapshot_file for this snap is: volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74df2c-29d9-4338-aa42-0bf28733fbb7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:09 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:26:09 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:10 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 1073741824" returned: 0 in 0.983s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:10 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 Jul 09 17:26:10 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:10 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.824s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29520064-bea0-4951-8cfb-c8f7384b0cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abc3edd-305e-4d1d-b199-382d6dc1e999]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:10 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:26:10 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:11 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" returned: 0 in 0.627s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f842ad-1e33-4ec8-9fdb-9019222b7284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8d408b-8f36-4dec-b49c-a0d334b7f4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:11 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Volume volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 (c99ad0b8-15dd-4297-996a-a4c46fd7abe5): created successfully Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8d408b-8f36-4dec-b49c-a0d334b7f4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (2129b9dd-75a0-4469-9539-1a7eff6fab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:11 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-de376739-01b3-4e05-be95-f65a4869bc81 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:26:11 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 0.769s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:11 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:26:11 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Creating offline snapshot f8432277-2846-47e0-bc05-b81254742e17 of volume c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92f20c1-0ca2-4776-9c96-cd89bd58a25d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:11 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 Jul 09 17:26:11 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:12 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.779s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:12 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004 Jul 09 17:26:12 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:12 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" returned: 0 in 0.872s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:12 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 1G Jul 09 17:26:12 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:12 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff.e4be8432-c792-4afc-b347-c144ae441004" returned: 0 in 0.670s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-e4be8432-c792-4afc-b347-c144ae441004" released by "_delete_snapshot" :: held 3.161s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" released by "delete_snapshot" :: held 3.187s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Created reservations ['d1224490-2a04-46c5-9bc0-a31c51be34a0', '8541be7d-5257-4a7a-ac6c-add0a1698324', 'aaf4c450-0e16-45d1-9afb-86c9e5eb7946', '1e12dbe2-9302-42fd-8f0f-8aeed48bb3f4'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Delete snapshot completed successfully. Jul 09 17:26:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-7002b768-87f7-4ade-a2a0-5e89229201fe tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-e4be8432-c792-4afc-b347-c144ae441004-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:13 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 1G" returned: 0 in 0.789s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:13 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 Jul 09 17:26:13 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-29520064-bea0-4951-8cfb-c8f7384b0cff-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-29520064-bea0-4951-8cfb-c8f7384b0cff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6167f2f-7562-45b8-8631-8397f9632aeb]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:14 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17" returned: 0 in 0.736s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:14 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 is being set with open permissions: ugo+rw Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:14 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:26:14 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:14 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 Jul 09 17:26:14 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:14 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17" returned: 0 in 0.698s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:14 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:14 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff Jul 09 17:26:14 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:14 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info Jul 09 17:26:14 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:15 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-29520064-bea0-4951-8cfb-c8f7384b0cff" returned: 0 in 0.677s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-29520064-bea0-4951-8cfb-c8f7384b0cff" released by "delete_volume" :: held 1.551s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:15 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info" returned: 0 in 0.724s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:15 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info is being set with open permissions: ugo+rw Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:15 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info Jul 09 17:26:15 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Created reservations ['6addbc31-1959-49f0-a085-0a3a157a27e0', '92ae1ed0-24a6-41a3-a337-4169e951bbc3', '40a6b02f-015d-4803-b088-7e2dc6e09d76', '7adea8ff-ea9a-4f74-bfef-e6911eb41d83'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:15 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:15 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-674fad54-bdd0-45d8-b2c1-eece5500cc9a-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-674fad54-bdd0-45d8-b2c1-eece5500cc9a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:16 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.info" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.627s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" acquired by "delete_volume" :: waited 0.050s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a341ce24-62b0-4c9a-9f17-d54b68440e94 tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c96c51-f15b-4c93-8aba-131a0e1ad345]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:16 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.707s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:16 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Deleted volume successfully. Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-566c1aab-1a6b-4084-94d8-cdf37d28539c tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-29520064-bea0-4951-8cfb-c8f7384b0cff-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:16 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a Jul 09 17:26:16 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-f8432277-2846-47e0-bc05-b81254742e17-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-f8432277-2846-47e0-bc05-b81254742e17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-f8432277-2846-47e0-bc05-b81254742e17" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-f8432277-2846-47e0-bc05-b81254742e17" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot f8432277-2846-47e0-bc05-b81254742e17 of volume c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:16 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a78a80-0805-4c0a-a866-839180c4842a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:17 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 Jul 09 17:26:17 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:17 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a" returned: 0 in 0.813s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:17 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a Jul 09 17:26:17 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:17 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-674fad54-bdd0-45d8-b2c1-eece5500cc9a" returned: 0 in 0.721s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:17 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17" returned: 0 in 0.870s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-quobyte-674fad54-bdd0-45d8-b2c1-eece5500cc9a" released by "delete_volume" :: held 1.607s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f32c74-816e-44a0-90dd-70ac35691889]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:17 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Created reservations ['10c67d0f-69c6-47c0-88aa-d3b832b42736', 'be1f3dcd-cc6a-4fc1-83ca-5e71f6f8b9d4', '30519838-252a-4eff-8b16-881bb89605ab', 'c48fa0e9-b1ab-426c-a884-ad939aa1f490'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:18 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 Jul 09 17:26:18 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:18 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:18 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:18 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" returned: 0 in 0.910s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:18 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.790s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:18 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 Jul 09 17:26:18 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:18 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Deleted volume successfully. Jul 09 17:26:18 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-5e7a6b6d-b80f-4a72-981f-9be111600b83 tempest-SnapshotDependencyTests-1594636114 None] Lock "cinder-674fad54-bdd0-45d8-b2c1-eece5500cc9a-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:19 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17" returned: 0 in 0.858s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:19 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17 Jul 09 17:26:19 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:20 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5.f8432277-2846-47e0-bc05-b81254742e17" returned: 0 in 0.692s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-f8432277-2846-47e0-bc05-b81254742e17" released by "_delete_snapshot" :: held 3.447s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" released by "delete_snapshot" :: held 3.473s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:20 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Created reservations ['6cfec821-ebbb-4f2e-a71d-58946152a226', '62d4eb29-7565-4156-8032-51d68d8a12f5', 'ea535697-2036-4051-b949-f71f9b58f8c5', 'd6bd64dc-a4c6-412a-b0f1-7b5a153fc805'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:20 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:26:20 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1e211075-bbde-440c-a588-157cd2f07102 tempest-ProjectMemberTests-336346371 None] Lock "cinder-f8432277-2846-47e0-bc05-b81254742e17-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-c99ad0b8-15dd-4297-996a-a4c46fd7abe5-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "cinder-c99ad0b8-15dd-4297-996a-a4c46fd7abe5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" acquired by "delete_volume" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c1dea-4e18-4741-92a7-f424bdca0145]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:21 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 Jul 09 17:26:21 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:22 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" returned: 0 in 0.777s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:22 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5 Jul 09 17:26:22 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:22 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" returned: 0 in 0.718s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-c99ad0b8-15dd-4297-996a-a4c46fd7abe5" released by "delete_volume" :: held 1.620s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Created reservations ['a4fc44dc-3757-41d0-9520-a6cba8424c58', '4d72c3d1-8d02-4b82-bf64-1fbf31ed32ba', 'db3c2ef9-c9b9-42c3-bc88-3a0713840559', '8529a22c-7547-4347-9b9b-f899bc974ffa'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:23 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:23 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:23 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.749s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:23 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e7947e8a-402c-4e59-a10b-1d66aa791cfa tempest-ProjectMemberTests-336346371 None] Lock "cinder-c99ad0b8-15dd-4297-996a-a4c46fd7abe5-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (950989ca-d8f0-4b24-b2b3-973ba180b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038f7641-6ff6-4532-89a1-23e857b7afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038f7641-6ff6-4532-89a1-23e857b7afd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1318182487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c1297d-a4b5-4792-8a8f-e87ad7a39665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:24Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e11c8-ee1a-4ea4-b53c-b939d8914098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e11c8-ee1a-4ea4-b53c-b939d8914098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b06d1-3d75-43f7-918d-d43050b3dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b06d1-3d75-43f7-918d-d43050b3dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c1297d-a4b5-4792-8a8f-e87ad7a39665', 'volume_name': 'volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58520372-cda0-4f25-8f93-3460a888cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58520372-cda0-4f25-8f93-3460a888cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c74964-ed3c-4598-8ba1-492de9b2d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:23 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Volume 57c1297d-a4b5-4792-8a8f-e87ad7a39665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665', 'volume_size': 1} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1318182487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c1297d-a4b5-4792-8a8f-e87ad7a39665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:24Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Creating volume 57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:26:23 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:26:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:24 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 1073741824 Jul 09 17:26:24 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:24 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 1073741824" returned: 0 in 0.882s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:24 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 Jul 09 17:26:24 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:25 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665" returned: 0 in 0.681s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c74964-ed3c-4598-8ba1-492de9b2d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec150e2-3fff-4de0-93b7-4abe0f72c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:25 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Volume volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 (57c1297d-a4b5-4792-8a8f-e87ad7a39665): created successfully Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec150e2-3fff-4de0-93b7-4abe0f72c956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:25 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (950989ca-d8f0-4b24-b2b3-973ba180b10b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-df9b4c6d-9946-4389-850f-af3d8d9681fe tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Creating offline snapshot 25fa5b7c-44db-433a-a184-eedd054b253f of volume 57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b0733-75c6-42ed-b6db-5e5639c3fc78]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:26 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 Jul 09 17:26:26 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:26 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665" returned: 0 in 0.816s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:27 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f 1G Jul 09 17:26:27 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:27 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f 1G" returned: 0 in 0.811s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:27 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f Jul 09 17:26:27 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:28 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f" returned: 0 in 0.652s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:28 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f is being set with open permissions: ugo+rw Jul 09 17:26:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:28 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f Jul 09 17:26:28 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:29 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f" returned: 0 in 0.603s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:29 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info Jul 09 17:26:29 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:29 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info" returned: 0 in 0.617s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:29 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info is being set with open permissions: ugo+rw Jul 09 17:26:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:29 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info Jul 09 17:26:29 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:30 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.info" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-929353f7-8c9a-412f-b03a-c1d5624d8fe7 tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-25fa5b7c-44db-433a-a184-eedd054b253f-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-25fa5b7c-44db-433a-a184-eedd054b253f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-25fa5b7c-44db-433a-a184-eedd054b253f" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-25fa5b7c-44db-433a-a184-eedd054b253f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot 25fa5b7c-44db-433a-a184-eedd054b253f of volume 57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b28243-6ce9-4846-aac0-f244eb2b28e4]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:31 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f Jul 09 17:26:31 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:32 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ec04e2-c9c9-41cd-a537-a7067f65aa86]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:32 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 Jul 09 17:26:32 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:32 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665" returned: 0 in 0.709s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:32 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f Jul 09 17:26:32 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:33 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f" returned: 0 in 0.679s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:33 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f Jul 09 17:26:33 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:34 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665.25fa5b7c-44db-433a-a184-eedd054b253f" returned: 0 in 0.610s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-25fa5b7c-44db-433a-a184-eedd054b253f" released by "_delete_snapshot" :: held 2.794s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" released by "delete_snapshot" :: held 2.817s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Created reservations ['3107a68b-4877-40b2-87c0-4421c444805d', '327ddf93-1677-4f9c-9ff3-2222d52acb34', '144c39da-92ac-4875-8e57-1c22614e585e', 'ce4e9f64-53f3-43e3-bedd-9700a914cbf3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-82a8ae69-61d7-49ee-8871-5d1a80bba9cf tempest-ProjectMemberTests-336346371 None] Lock "cinder-25fa5b7c-44db-433a-a184-eedd054b253f-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-57c1297d-a4b5-4792-8a8f-e87ad7a39665-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "cinder-57c1297d-a4b5-4792-8a8f-e87ad7a39665-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" acquired by "delete_volume" :: waited 0.012s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece245a7-10af-4741-b4d9-4235f62a90f0]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:34 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 Jul 09 17:26:34 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:35 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665" returned: 0 in 0.710s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:35 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665 Jul 09 17:26:35 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:35 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-57c1297d-a4b5-4792-8a8f-e87ad7a39665" returned: 0 in 0.619s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:35 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-57c1297d-a4b5-4792-8a8f-e87ad7a39665" released by "delete_volume" :: held 1.384s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Created reservations ['95d5e030-8d83-4672-8f1f-7f3c14c1767d', '27b3c626-184f-49b9-ac4d-4288ab2f1fcd', 'e728239a-0e96-4248-b8f8-02ba3ab50e37', '71eaa002-b0ec-4509-822d-d934533198a7'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:36 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:36 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:36 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.630s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:36 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:26:36 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d052c810-ae38-4435-9fe5-e2b2fe37c27f tempest-ProjectMemberTests-336346371 None] Lock "cinder-57c1297d-a4b5-4792-8a8f-e87ad7a39665-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (0d8eb948-447a-41d1-b582-af7a8196bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8279a2-77c2-436f-9b42-fba4e3740da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8279a2-77c2-436f-9b42-fba4e3740da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879338862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c7f4c9-5322-43f7-831f-d2c4fa832d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:37Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71171a1-ce59-4aa3-890d-29d70e20bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71171a1-ce59-4aa3-890d-29d70e20bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ed9add-f53f-4275-b767-2bd3e21c546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ed9add-f53f-4275-b767-2bd3e21c546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c7f4c9-5322-43f7-831f-d2c4fa832d1a', 'volume_name': 'volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca360f30-c35c-4e3a-b6dd-0058110e0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca360f30-c35c-4e3a-b6dd-0058110e0437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b90d1b6-82cc-43f5-9de7-87cb69bfea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:37 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Volume a1c7f4c9-5322-43f7-831f-d2c4fa832d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a', 'volume_size': 1} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879338862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c7f4c9-5322-43f7-831f-d2c4fa832d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:37Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Creating volume a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:26:37 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:26:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:37 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a 1073741824 Jul 09 17:26:37 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:38 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a 1073741824" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:38 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a Jul 09 17:26:38 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:38 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" returned: 0 in 0.619s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b90d1b6-82cc-43f5-9de7-87cb69bfea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f9642b-f8cd-4d92-8243-835a4566229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:38 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Volume volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a (a1c7f4c9-5322-43f7-831f-d2c4fa832d1a): created successfully Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f9642b-f8cd-4d92-8243-835a4566229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:38 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (0d8eb948-447a-41d1-b582-af7a8196bad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-2325251c-d876-4406-8586-3d354c9d5924 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:26:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Creating offline snapshot aaa461ff-d116-4618-b52c-eb046253ddae of volume a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:26:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda9c66-2006-43b7-a8c4-3c4ee0f472b1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:39 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a Jul 09 17:26:39 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:40 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" returned: 0 in 0.713s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:40 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae 1G Jul 09 17:26:40 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:40 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae 1G" returned: 0 in 0.779s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:40 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae Jul 09 17:26:40 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:41 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae" returned: 0 in 0.647s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:41 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae is being set with open permissions: ugo+rw Jul 09 17:26:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:41 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae Jul 09 17:26:41 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:42 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae" returned: 0 in 0.600s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:42 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info Jul 09 17:26:42 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:42 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info" returned: 0 in 0.611s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:42 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info is being set with open permissions: ugo+rw Jul 09 17:26:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:42 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info Jul 09 17:26:42 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:43 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.info" returned: 0 in 0.612s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.037s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:43 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-8f4c4b85-3a2f-4352-bfbc-b960c623d90e tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-aaa461ff-d116-4618-b52c-eb046253ddae-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-aaa461ff-d116-4618-b52c-eb046253ddae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-aaa461ff-d116-4618-b52c-eb046253ddae" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-aaa461ff-d116-4618-b52c-eb046253ddae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot aaa461ff-d116-4618-b52c-eb046253ddae of volume a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d46e3b4-6be8-4236-9ef6-7f85d8d5518b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:43 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae Jul 09 17:26:43 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:44 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae" returned: 0 in 0.713s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:44 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:44 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc100d-d566-44f6-8ac0-6bf6fdb5bdd9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:44 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a Jul 09 17:26:44 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:45 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" returned: 0 in 0.715s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:45 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae Jul 09 17:26:45 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:45 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae" returned: 0 in 0.716s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:45 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae Jul 09 17:26:45 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:46 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a.aaa461ff-d116-4618-b52c-eb046253ddae" returned: 0 in 0.614s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-aaa461ff-d116-4618-b52c-eb046253ddae" released by "_delete_snapshot" :: held 2.841s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" released by "delete_snapshot" :: held 2.860s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Created reservations ['71efeb2e-9a1a-4701-9daf-8ef7ff2dac53', 'f664c114-7978-4544-b2f0-3617931c82a6', 'c53ac0da-8167-4642-bd8b-17c9a5c5b95c', '44b6d175-00cf-416d-944d-00c4fc605bb3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-429443de-3b73-4219-8d1b-9895d6487d50 tempest-ProjectMemberTests-336346371 None] Lock "cinder-aaa461ff-d116-4618-b52c-eb046253ddae-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "cinder-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84209ff-4bd8-4c73-8bf8-decf762bb38a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:46 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a Jul 09 17:26:46 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:47 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" returned: 0 in 0.724s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:47 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a Jul 09 17:26:47 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:48 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" returned: 0 in 0.638s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a" released by "delete_volume" :: held 1.419s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Created reservations ['7007ebaa-863f-40f9-84ed-03a5cffb6e06', '8d4dd688-0402-4d14-9eff-73be684d984a', 'b8effe36-0612-4b31-b92e-0654b876d4c1', '73c0af17-d207-4f42-add9-2d777b66beab'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:48 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:26:48 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:48 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:26:48 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:26:48 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91e67437-0c11-4895-87e4-26000f1289bc tempest-ProjectMemberTests-336346371 None] Lock "cinder-a1c7f4c9-5322-43f7-831f-d2c4fa832d1a-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (18e584de-9768-465b-90a7-4fe54cd88a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17441fdd-4136-48fd-9b2d-47b2c763c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17441fdd-4136-48fd-9b2d-47b2c763c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913688805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8456bc-8f9f-41a6-90be-160d9830cd48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:49Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa6951-d23c-400d-9a05-5bd7bf375d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa6951-d23c-400d-9a05-5bd7bf375d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f31e0-2abf-4986-8ade-675e0ed9a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f31e0-2abf-4986-8ade-675e0ed9a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8456bc-8f9f-41a6-90be-160d9830cd48', 'volume_name': 'volume-3d8456bc-8f9f-41a6-90be-160d9830cd48', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e49b2e2-63cc-437f-af29-59da2af6d89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e49b2e2-63cc-437f-af29-59da2af6d89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4835a1e-46b4-47df-ac1d-947436d84d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:49 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Volume 3d8456bc-8f9f-41a6-90be-160d9830cd48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8456bc-8f9f-41a6-90be-160d9830cd48', 'volume_size': 1} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913688805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8456bc-8f9f-41a6-90be-160d9830cd48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:26:49Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Creating volume 3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:26:49 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:26:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:49 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 1073741824 Jul 09 17:26:49 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:50 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 1073741824" returned: 0 in 0.779s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:50 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 Jul 09 17:26:50 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:50 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48" returned: 0 in 0.637s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4835a1e-46b4-47df-ac1d-947436d84d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8456bc-8f9f-41a6-90be-160d9830cd48', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade469a7-0138-4d59-a460-7d3132e26196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:26:50 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Volume volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 (3d8456bc-8f9f-41a6-90be-160d9830cd48): created successfully Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade469a7-0138-4d59-a460-7d3132e26196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:26:50 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (18e584de-9768-465b-90a7-4fe54cd88a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:26:50 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1e23760a-f932-4af0-935f-190d6917e1ba tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:26:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:26:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:26:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Creating offline snapshot e9626017-5496-4164-9f91-74c748aaa13f of volume 3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:26:51 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d5bdb2-b110-4f02-b2bd-a7811a391fd8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:51 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 Jul 09 17:26:51 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:52 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48" returned: 0 in 0.716s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:52 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f 1G Jul 09 17:26:52 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:53 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f 1G" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:53 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f Jul 09 17:26:53 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:53 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f" returned: 0 in 0.665s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:53 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f is being set with open permissions: ugo+rw Jul 09 17:26:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:53 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f Jul 09 17:26:53 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:54 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f" returned: 0 in 0.616s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:54 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info Jul 09 17:26:54 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:55 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info" returned: 0 in 0.626s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:55 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info is being set with open permissions: ugo+rw Jul 09 17:26:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:55 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info Jul 09 17:26:55 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:55 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.info" returned: 0 in 0.630s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:26:55 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-460ff92f-8ad7-4992-8aca-d8ef8797071e tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-e9626017-5496-4164-9f91-74c748aaa13f-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-e9626017-5496-4164-9f91-74c748aaa13f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-e9626017-5496-4164-9f91-74c748aaa13f" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e9626017-5496-4164-9f91-74c748aaa13f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot e9626017-5496-4164-9f91-74c748aaa13f of volume 3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b50ad-29de-423d-90f4-c71463fd091d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:57 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f Jul 09 17:26:57 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:57 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f" returned: 0 in 0.824s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:57 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8456bc-8f9f-41a6-90be-160d9830cd48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:26:57 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda8945-e5ea-4fef-8635-229d00f6c583]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:26:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:57 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 Jul 09 17:26:57 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:58 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48" returned: 0 in 0.750s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:58 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f Jul 09 17:26:58 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:59 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f" returned: 0 in 0.746s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:26:59 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f Jul 09 17:26:59 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:26:59 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48.e9626017-5496-4164-9f91-74c748aaa13f" returned: 0 in 0.643s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-e9626017-5496-4164-9f91-74c748aaa13f" released by "_delete_snapshot" :: held 3.051s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" released by "delete_snapshot" :: held 3.079s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:26:59 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Created reservations ['23765f85-88a9-4982-8541-7bfb3e216bd4', 'd2d58516-750d-4d0c-9c7d-6eaac8fd5787', '1d9b6b41-3548-4060-aa3a-cd067e5b0ab9', '3cf43862-1dab-4466-a3ae-f6a264443502'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:00 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-9817cffb-3a22-4463-b7d7-7623b1e142a8 tempest-ProjectMemberTests-336346371 None] Lock "cinder-e9626017-5496-4164-9f91-74c748aaa13f-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:00 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:27:00 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-3d8456bc-8f9f-41a6-90be-160d9830cd48-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-3d8456bc-8f9f-41a6-90be-160d9830cd48-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6efd80-9f5c-4a27-9395-655599d8e226]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:01 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.673s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:27:01 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 Jul 09 17:27:01 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:01 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:01 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48 Jul 09 17:27:01 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:02 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-3d8456bc-8f9f-41a6-90be-160d9830cd48" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-3d8456bc-8f9f-41a6-90be-160d9830cd48" released by "delete_volume" :: held 1.459s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Created reservations ['a782316b-1851-4ebb-850f-96f7c9c1d1ee', '92e36f40-f632-4e36-94dd-bf8386cb3cf6', '8bb76b49-c48f-44eb-b67f-f9cb0acb5d49', 'd78d970f-eff8-4efe-9b13-5cbe5ed41372'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:02 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:27:02 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:03 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.641s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:27:03 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-ecaf9f66-5283-46f0-86e1-d9985bd7bda5 tempest-ProjectMemberTests-336346371 None] Lock "cinder-3d8456bc-8f9f-41a6-90be-160d9830cd48-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (e9c20928-009a-43df-b13d-e051a5a7c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fe8f70-bd2e-4d6f-93d8-ec2eb5f6f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fe8f70-bd2e-4d6f-93d8-ec2eb5f6f23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34201723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8f0451-d18c-4eb6-a66d-208e738204ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:04Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35122486-2545-4f07-bb28-0adbc279c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35122486-2545-4f07-bb28-0adbc279c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217a88dd-08d8-4bac-8da2-d8a3cd8c9cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217a88dd-08d8-4bac-8da2-d8a3cd8c9cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8f0451-d18c-4eb6-a66d-208e738204ca', 'volume_name': 'volume-9f8f0451-d18c-4eb6-a66d-208e738204ca', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f292d33-c822-4bf1-aeb9-0f3d150e92f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f292d33-c822-4bf1-aeb9-0f3d150e92f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6f9f8d-0e95-40b4-82ec-efcba229d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:03 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Volume 9f8f0451-d18c-4eb6-a66d-208e738204ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8f0451-d18c-4eb6-a66d-208e738204ca', 'volume_size': 1} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34201723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8f0451-d18c-4eb6-a66d-208e738204ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:04Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Creating volume 9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:27:03 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:27:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:03 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca 1073741824 Jul 09 17:27:03 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:04 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca 1073741824" returned: 0 in 0.789s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:04 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca Jul 09 17:27:04 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:05 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca" returned: 0 in 0.632s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6f9f8d-0e95-40b4-82ec-efcba229d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8f0451-d18c-4eb6-a66d-208e738204ca', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a259153b-9063-4c90-a988-11a2ad01ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:05 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Volume volume-9f8f0451-d18c-4eb6-a66d-208e738204ca (9f8f0451-d18c-4eb6-a66d-208e738204ca): created successfully Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a259153b-9063-4c90-a988-11a2ad01ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (e9c20928-009a-43df-b13d-e051a5a7c330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:05 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-16b0d3c9-71a9-42ad-994d-a1ddc1e65d2b tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Creating offline snapshot eb420467-9ade-4ce9-aed2-2a757bbdf396 of volume 9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ec369-28b5-44fd-9322-6bc936f3160f]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:06 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca Jul 09 17:27:06 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:06 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca" returned: 0 in 0.749s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:06 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 1G Jul 09 17:27:06 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:07 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 1G" returned: 0 in 0.791s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0451-d18c-4eb6-a66d-208e738204ca -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:07 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0451-d18c-4eb6-a66d-208e738204ca -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 Jul 09 17:27:07 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:08 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8f0451-d18c-4eb6-a66d-208e738204ca -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396" returned: 0 in 0.678s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:08 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 is being set with open permissions: ugo+rw Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:08 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 Jul 09 17:27:08 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:08 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396" returned: 0 in 0.713s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=86,cinder:INSERT=26,cinder:UPDATE=104,cinder:DELETE=10 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=76,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:27:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:08 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info Jul 09 17:27:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info" returned: 0 in 0.648s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:09 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info is being set with open permissions: ugo+rw Jul 09 17:27:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:09 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info Jul 09 17:27:09 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:10 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.info" returned: 0 in 0.670s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.328s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:10 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e82cfa1c-cf51-401e-bf6b-2b24be3a2e14 tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-eb420467-9ade-4ce9-aed2-2a757bbdf396-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-eb420467-9ade-4ce9-aed2-2a757bbdf396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-eb420467-9ade-4ce9-aed2-2a757bbdf396" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-eb420467-9ade-4ce9-aed2-2a757bbdf396" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot eb420467-9ade-4ce9-aed2-2a757bbdf396 of volume 9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610ddde-ade7-46da-b95c-af09dc5b5ed3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:11 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 Jul 09 17:27:11 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:12 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396" returned: 0 in 0.792s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f8f0451-d18c-4eb6-a66d-208e738204ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d5fc3-15aa-4837-b731-f8509eb25986]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:12 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca Jul 09 17:27:12 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:12 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca" returned: 0 in 0.814s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:12 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 Jul 09 17:27:12 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:13 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396" returned: 0 in 0.734s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:13 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396 Jul 09 17:27:13 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:14 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca.eb420467-9ade-4ce9-aed2-2a757bbdf396" returned: 0 in 0.651s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-eb420467-9ade-4ce9-aed2-2a757bbdf396" released by "_delete_snapshot" :: held 3.078s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" released by "delete_snapshot" :: held 3.100s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Created reservations ['54a40848-40a6-43bb-ae4a-0ef49c558751', '327800ce-9f90-4c3a-8feb-6a18184b2966', 'f426ffbc-c1a1-4074-bc09-fce3790bc1a7', '6bc1de7d-fa62-47f5-9184-9fb0d4eecd35'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:14 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:27:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-91c1965d-879a-4e68-abf8-5a722f03f92d tempest-ProjectMemberTests-336346371 None] Lock "cinder-eb420467-9ade-4ce9-aed2-2a757bbdf396-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-9f8f0451-d18c-4eb6-a66d-208e738204ca-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "cinder-9f8f0451-d18c-4eb6-a66d-208e738204ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197b9c4-9738-4fe0-9a15-f10fcdc47b3a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:15 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca Jul 09 17:27:15 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:16 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca" returned: 0 in 0.764s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:16 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca Jul 09 17:27:16 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-9f8f0451-d18c-4eb6-a66d-208e738204ca" returned: 0 in 0.688s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:16 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-9f8f0451-d18c-4eb6-a66d-208e738204ca" released by "delete_volume" :: held 1.512s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Created reservations ['82b0de5a-829a-45bb-a554-1e202202ebd2', '1e6a2767-bc54-4818-b795-d94cf4043712', '1e2f491c-14a7-4e0e-ac6a-c00d1d8fa470', 'bbd1c932-1bf1-4d8c-bfd9-73dd25371931'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:17 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:27:17 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:17 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.659s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:27:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:27:17 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-a798f288-f49f-448f-aade-8e97c824cbaf tempest-ProjectMemberTests-336346371 None] Lock "cinder-9f8f0451-d18c-4eb6-a66d-208e738204ca-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (99c3e3a8-62d7-4661-b4b6-36784d2c9708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a42b8d-ec74-4b2e-a89f-573ff849d729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a42b8d-ec74-4b2e-a89f-573ff849d729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460822770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8108354c-07bd-47f1-aa2a-b8d40fc25f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:18Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64f17e-45fe-4124-b5ad-845e05f203d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64f17e-45fe-4124-b5ad-845e05f203d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f1170e-7150-4c18-bae3-c8fe769f4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f1170e-7150-4c18-bae3-c8fe769f4f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8108354c-07bd-47f1-aa2a-b8d40fc25f6d', 'volume_name': 'volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9b804d-de71-4bab-b53c-f1a30eda34f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9b804d-de71-4bab-b53c-f1a30eda34f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993bdf91-182d-4727-8d75-451ad957ae0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:18 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Volume 8108354c-07bd-47f1-aa2a-b8d40fc25f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d', 'volume_size': 1} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460822770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8108354c-07bd-47f1-aa2a-b8d40fc25f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:18Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Creating volume 8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:27:18 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:18 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d 1073741824 Jul 09 17:27:18 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:18 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d 1073741824" returned: 0 in 0.793s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:19 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d Jul 09 17:27:19 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:19 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" returned: 0 in 0.659s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993bdf91-182d-4727-8d75-451ad957ae0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b78ad20-39b9-4e62-bd79-132a99a4c3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:19 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Volume volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d (8108354c-07bd-47f1-aa2a-b8d40fc25f6d): created successfully Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b78ad20-39b9-4e62-bd79-132a99a4c3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:19 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (99c3e3a8-62d7-4661-b4b6-36784d2c9708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:19 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3c5918a9-50d9-4316-b8be-08298e611ea7 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:27:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:20 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Creating offline snapshot a1956698-8d86-4a7e-9cd7-08532fc87040 of volume 8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:27:20 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d248db-5ad8-495b-8be9-a14c11f7bcbf]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:20 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d Jul 09 17:27:20 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:21 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" returned: 0 in 0.735s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:21 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 1G Jul 09 17:27:21 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:21 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 1G" returned: 0 in 0.776s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:21 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 Jul 09 17:27:21 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:22 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040" returned: 0 in 0.659s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:22 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 is being set with open permissions: ugo+rw Jul 09 17:27:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:22 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 Jul 09 17:27:22 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:23 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040" returned: 0 in 0.668s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:23 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info Jul 09 17:27:23 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:23 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info" returned: 0 in 0.632s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:23 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info is being set with open permissions: ugo+rw Jul 09 17:27:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:23 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info Jul 09 17:27:23 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:24 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.info" returned: 0 in 0.690s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.250s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:24 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-16119909-5971-4163-a4d0-0ce25538689a tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-a1956698-8d86-4a7e-9cd7-08532fc87040-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-a1956698-8d86-4a7e-9cd7-08532fc87040-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-a1956698-8d86-4a7e-9cd7-08532fc87040" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1956698-8d86-4a7e-9cd7-08532fc87040" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot a1956698-8d86-4a7e-9cd7-08532fc87040 of volume 8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f1043-0095-49d2-a7a2-5e15fe1f4bae]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:25 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 Jul 09 17:27:25 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:26 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040" returned: 0 in 0.757s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:27:26 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b4e62-d174-4f66-9d3a-8e67cdb44ff6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:26 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d Jul 09 17:27:26 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:27 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" returned: 0 in 0.731s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:27 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 Jul 09 17:27:27 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:27 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040" returned: 0 in 0.717s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:27 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040 Jul 09 17:27:27 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:28 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d.a1956698-8d86-4a7e-9cd7-08532fc87040" returned: 0 in 0.669s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-a1956698-8d86-4a7e-9cd7-08532fc87040" released by "_delete_snapshot" :: held 2.963s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" released by "delete_snapshot" :: held 2.986s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Created reservations ['de685b67-f8f2-438e-9a9a-829c641ea552', 'c4da6458-7aa7-4a0a-a54b-5e9423c3d42f', '0d1420dd-29a1-4aeb-912f-6eba4af57924', '5d9adef3-857b-4632-9051-72d30c18ece7'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:28 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-04714382-e9cb-48f7-91fa-45203e424511 tempest-ProjectMemberTests-336346371 None] Lock "cinder-a1956698-8d86-4a7e-9cd7-08532fc87040-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-8108354c-07bd-47f1-aa2a-b8d40fc25f6d-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "cinder-8108354c-07bd-47f1-aa2a-b8d40fc25f6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" acquired by "delete_volume" :: waited 0.012s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010d451-18e9-41f3-991c-60216e810b95]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:28 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d Jul 09 17:27:28 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:29 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:29 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d Jul 09 17:27:29 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:30 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" returned: 0 in 0.609s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-8108354c-07bd-47f1-aa2a-b8d40fc25f6d" released by "delete_volume" :: held 1.395s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Created reservations ['a2a7e41f-3248-4229-bc27-9ef6741ff7d7', 'a97abae7-cf8c-4496-9340-7c61a8484495', '9cee9fca-ab44-43f6-8a1e-601bece8979f', '58ed44f5-8bf5-42d2-af4a-61d5d7b4dd4c'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:30 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:27:30 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:30 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.635s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:30 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:27:30 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e317dc73-270c-4d9d-a177-4526c78dfb3c tempest-ProjectMemberTests-336346371 None] Lock "cinder-8108354c-07bd-47f1-aa2a-b8d40fc25f6d-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (4f25618c-ece8-46ff-b9b0-05711496bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16cc31a-be88-41f4-92a6-185c25db4b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16cc31a-be88-41f4-92a6-185c25db4b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130139596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e91fa-c556-4c4d-8ad1-28bb85b9121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:31Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92eaa86-ca71-4b22-928c-07589f0b76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92eaa86-ca71-4b22-928c-07589f0b76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4a196f-e0fd-4db4-9d1f-ab7ab81413d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4a196f-e0fd-4db4-9d1f-ab7ab81413d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423e91fa-c556-4c4d-8ad1-28bb85b9121b', 'volume_name': 'volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d8156a-db4f-4d05-b2c1-92bc4a1df60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d8156a-db4f-4d05-b2c1-92bc4a1df60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d97390-80ba-4a21-a0fe-83c3b07b476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:31 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Volume 423e91fa-c556-4c4d-8ad1-28bb85b9121b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b', 'volume_size': 1} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130139596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e91fa-c556-4c4d-8ad1-28bb85b9121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f403ab530c474ea91b2dfcb5be215c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:31Z,use_quota=True,user_id='e0c21906550545cfb850da202eaa788f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Creating volume 423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:27:31 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:27:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:31 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b 1073741824 Jul 09 17:27:31 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:32 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b 1073741824" returned: 0 in 0.821s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:32 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b Jul 09 17:27:32 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:32 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b" returned: 0 in 0.639s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:32 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:27:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d97390-80ba-4a21-a0fe-83c3b07b476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e6056c-d4d4-4809-88c3-28a6086e94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:33 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Volume volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b (423e91fa-c556-4c4d-8ad1-28bb85b9121b): created successfully Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e6056c-d4d4-4809-88c3-28a6086e94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Flow 'volume_create_manager' (4f25618c-ece8-46ff-b9b0-05711496bc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:33 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-9c01b8c7-fc4b-4872-a8d2-562aaa567e17 tempest-ProjectMemberTests-336346371 None] Created volume successfully. Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Creating offline snapshot 60142da9-646e-429b-90e8-c9cb97b13105 of volume 423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[06971ffc-a011-4aab-8dcb-4bd22a6d0e85]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:33 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b Jul 09 17:27:33 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:34 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b" returned: 0 in 0.832s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:34 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 1G Jul 09 17:27:34 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:35 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 1G" returned: 0 in 0.781s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:35 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 Jul 09 17:27:35 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:36 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105" returned: 0 in 0.728s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:36 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 is being set with open permissions: ugo+rw Jul 09 17:27:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:36 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 Jul 09 17:27:36 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:36 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105" returned: 0 in 0.639s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:36 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info Jul 09 17:27:36 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:37 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info" returned: 0 in 0.642s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:37 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info is being set with open permissions: ugo+rw Jul 09 17:27:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:37 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info Jul 09 17:27:37 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:37 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.info" returned: 0 in 0.631s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:38 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-7457fc21-2aa8-4ae0-a133-81ac88773596 tempest-ProjectMemberTests-336346371 None] Create snapshot completed successfully Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-60142da9-646e-429b-90e8-c9cb97b13105-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-60142da9-646e-429b-90e8-c9cb97b13105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-60142da9-646e-429b-90e8-c9cb97b13105" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-60142da9-646e-429b-90e8-c9cb97b13105" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Deleting offline snapshot 60142da9-646e-429b-90e8-c9cb97b13105 of volume 423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] snapshot_file for this snap is: volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a8b96-c95a-43fd-ad47-51c8bf538eab]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:39 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 Jul 09 17:27:39 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:39 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a41d5-d702-45cd-8bde-79a127aa9123]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:39 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b Jul 09 17:27:39 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:40 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b" returned: 0 in 0.755s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:40 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 Jul 09 17:27:40 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:41 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105" returned: 0 in 0.708s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:41 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105 Jul 09 17:27:41 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:41 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b.60142da9-646e-429b-90e8-c9cb97b13105" returned: 0 in 0.625s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-60142da9-646e-429b-90e8-c9cb97b13105" released by "_delete_snapshot" :: held 2.950s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:41 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" released by "delete_snapshot" :: held 2.970s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Created reservations ['dd422480-ce27-4dc9-aee7-486263781cd4', '34f42d5a-22e3-466e-8e67-7ed07deef4a2', '59d47ac5-810d-4f67-8e11-4ff7851b92b7', '1ef4fd46-529a-4cf3-939f-33d9fda3ab4f'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:42 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Delete snapshot completed successfully. Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f0dae789-6d45-404b-9e99-907a1f462db4 tempest-ProjectMemberTests-336346371 None] Lock "cinder-60142da9-646e-429b-90e8-c9cb97b13105-delete_snapshot" released by "delete_snapshot" :: held 3.103s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-423e91fa-c556-4c4d-8ad1-28bb85b9121b-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "cinder-423e91fa-c556-4c4d-8ad1-28bb85b9121b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Acquiring lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909a793-a1df-49cd-8c40-95c8584a6ac8]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:42 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b Jul 09 17:27:42 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:43 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b" returned: 0 in 0.770s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:43 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b Jul 09 17:27:43 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:43 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-423e91fa-c556-4c4d-8ad1-28bb85b9121b" returned: 0 in 0.627s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "cinder-quobyte-423e91fa-c556-4c4d-8ad1-28bb85b9121b" released by "delete_volume" :: held 1.453s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Created reservations ['59efe0f2-ff99-42d1-aca9-1424d788170e', '921c27ad-a7a8-4b5b-ab97-bfa5d008a748', 'a210c9ba-b098-4ed9-93c4-e37a5debd669', '721f2b1b-6a40-4a1c-9057-900c260fd264'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:43 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:27:43 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:44 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.666s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:44 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:27:44 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Deleted volume successfully. Jul 09 17:27:44 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0b72cf4e-82a7-491d-9d8e-0561e9cf3e87 tempest-ProjectMemberTests-336346371 None] Lock "cinder-423e91fa-c556-4c4d-8ad1-28bb85b9121b-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (f97bfab4-98b7-4f2b-8915-02e17b7b0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe5116e-e645-4108-a589-2d61747b4330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe5116e-e645-4108-a589-2d61747b4330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051496283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3372f91-2acb-42c9-9055-088688dd6913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:48Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212bdcb5-8a10-41bd-adc1-91c6fde7c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212bdcb5-8a10-41bd-adc1-91c6fde7c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a28c7b-8aab-4820-9027-e3793604bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a28c7b-8aab-4820-9027-e3793604bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3372f91-2acb-42c9-9055-088688dd6913', 'volume_name': 'volume-d3372f91-2acb-42c9-9055-088688dd6913', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed724c-59e2-4e2b-af88-2962e689b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed724c-59e2-4e2b-af88-2962e689b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053387f1-0bf5-4402-869f-9f8e873ad259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:47 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Volume d3372f91-2acb-42c9-9055-088688dd6913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3372f91-2acb-42c9-9055-088688dd6913', 'volume_size': 1} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051496283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3372f91-2acb-42c9-9055-088688dd6913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:27:48Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Creating volume d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:27:47 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:27:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:47 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 1073741824 Jul 09 17:27:47 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:48 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 1073741824" returned: 0 in 0.810s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:48 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 Jul 09 17:27:48 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:49 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913" returned: 0 in 0.639s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053387f1-0bf5-4402-869f-9f8e873ad259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3372f91-2acb-42c9-9055-088688dd6913', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76375453-77f7-4d5b-a25e-6ee1299926f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:27:49 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Volume volume-d3372f91-2acb-42c9-9055-088688dd6913 (d3372f91-2acb-42c9-9055-088688dd6913): created successfully Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76375453-77f7-4d5b-a25e-6ee1299926f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:27:49 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (f97bfab4-98b7-4f2b-8915-02e17b7b0bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:27:49 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-df1344d5-be87-4750-85ca-9c9f55764288 tempest-ProjectReaderTests-955233739 None] Created volume successfully. Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Creating offline snapshot 9794fcc0-16ec-4683-8065-c2a11485bc2d of volume d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[3250438c-088e-4470-ac53-4ae25d735fb9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:50 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 Jul 09 17:27:50 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:50 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913" returned: 0 in 0.763s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:50 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d 1G Jul 09 17:27:50 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:51 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d 1G" returned: 0 in 0.812s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3372f91-2acb-42c9-9055-088688dd6913 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:51 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3372f91-2acb-42c9-9055-088688dd6913 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d Jul 09 17:27:51 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:52 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3372f91-2acb-42c9-9055-088688dd6913 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d" returned: 0 in 0.720s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:52 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d is being set with open permissions: ugo+rw Jul 09 17:27:52 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:52 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d Jul 09 17:27:52 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:53 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:53 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info Jul 09 17:27:53 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:53 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info" returned: 0 in 0.665s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:53 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info is being set with open permissions: ugo+rw Jul 09 17:27:53 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:53 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info Jul 09 17:27:53 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:54 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.info" returned: 0 in 0.649s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:54 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:27:54 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-335fb300-3cad-4245-9460-d78d4dfed320 tempest-ProjectReaderTests-955233739 None] Create snapshot completed successfully Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-9794fcc0-16ec-4683-8065-c2a11485bc2d-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-9794fcc0-16ec-4683-8065-c2a11485bc2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-9794fcc0-16ec-4683-8065-c2a11485bc2d" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-9794fcc0-16ec-4683-8065-c2a11485bc2d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Deleting offline snapshot 9794fcc0-16ec-4683-8065-c2a11485bc2d of volume d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] snapshot_file for this snap is: volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c53229-3817-4f82-bae7-d01d99ba9de9]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:55 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:55 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d Jul 09 17:27:55 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:56 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:56 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3372f91-2acb-42c9-9055-088688dd6913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:27:56 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d328c-863d-4f42-a7fc-ba5ca8a062f1]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:56 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:56 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 Jul 09 17:27:56 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:57 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913" returned: 0 in 0.759s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:57 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d Jul 09 17:27:57 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:57 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d" returned: 0 in 0.769s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:57 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:57 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d Jul 09 17:27:57 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:27:58 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 09 17:27:58 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913.9794fcc0-16ec-4683-8065-c2a11485bc2d" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:27:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-9794fcc0-16ec-4683-8065-c2a11485bc2d" released by "_delete_snapshot" :: held 3.039s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" released by "delete_snapshot" :: held 3.066s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:58 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Created reservations ['18848f56-29e2-4dee-b8fb-9014c61ee756', 'c86a9e0d-9494-4b0e-8058-ab9b5f32da55', '404ef6d9-3435-4800-8487-c6e0f07dee5d', '7c7aef84-fab7-44c0-9952-98260dacbad1'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:27:58 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Delete snapshot completed successfully. Jul 09 17:27:58 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-428cea64-2281-457d-a9e7-d625af11409b tempest-ProjectReaderTests-955233739 None] Lock "cinder-9794fcc0-16ec-4683-8065-c2a11485bc2d-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-d3372f91-2acb-42c9-9055-088688dd6913-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "cinder-d3372f91-2acb-42c9-9055-088688dd6913-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b209d-bf42-4a6f-8c18-ecdb3387681d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:27:59 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:27:59 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 Jul 09 17:27:59 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:00 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:00 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:00 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913" returned: 0 in 0.800s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:00 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913 Jul 09 17:28:00 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:01 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.696s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:01 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-d3372f91-2acb-42c9-9055-088688dd6913" returned: 0 in 0.652s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-d3372f91-2acb-42c9-9055-088688dd6913" released by "delete_volume" :: held 1.510s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Created reservations ['f29b2fdb-1153-4bd4-aa7a-f55629743e0a', '06c50d8d-3ea0-498b-9b99-541fb0020b0d', '260e105d-b62d-414e-ad58-e51a820d2584', '062d5b0d-a2f0-4c26-8a23-de5cf4316590'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:01 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:01 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:02 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.683s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:02 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Deleted volume successfully. Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-db63a130-97cf-4a9b-87b6-de4bfd9d858d tempest-ProjectReaderTests-955233739 None] Lock "cinder-d3372f91-2acb-42c9-9055-088688dd6913-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (daf8e9c3-e5ca-497c-afd4-192b1075460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d06ad9-2bc8-423d-a67f-783ae7d7e79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d06ad9-2bc8-423d-a67f-783ae7d7e79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-404633841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fc509d-6cbc-498d-9380-7c3cb6316a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:02Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d8a022-9f69-44bd-8d08-e77f79b5cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d8a022-9f69-44bd-8d08-e77f79b5cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539ed0c7-1fd9-4f74-9e17-2f6507344ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539ed0c7-1fd9-4f74-9e17-2f6507344ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fc509d-6cbc-498d-9380-7c3cb6316a54', 'volume_name': 'volume-96fc509d-6cbc-498d-9380-7c3cb6316a54', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9493952-0c9a-4f9f-bd0c-e1cf2b4428b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9493952-0c9a-4f9f-bd0c-e1cf2b4428b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f6fc2-fe0b-41c2-8e41-3bea68bd229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:02 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Volume 96fc509d-6cbc-498d-9380-7c3cb6316a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fc509d-6cbc-498d-9380-7c3cb6316a54', 'volume_size': 1} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-404633841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fc509d-6cbc-498d-9380-7c3cb6316a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:02Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Creating volume 96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:28:02 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:28:02 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:02 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 1073741824 Jul 09 17:28:02 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:03 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 1073741824" returned: 0 in 0.894s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:03 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:03 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 Jul 09 17:28:03 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:04 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54" returned: 0 in 0.664s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f6fc2-fe0b-41c2-8e41-3bea68bd229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fc509d-6cbc-498d-9380-7c3cb6316a54', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d1d44d-24c3-49bc-8289-ca8c68d49d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:04 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Volume volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 (96fc509d-6cbc-498d-9380-7c3cb6316a54): created successfully Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d1d44d-24c3-49bc-8289-ca8c68d49d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (daf8e9c3-e5ca-497c-afd4-192b1075460e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:04 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0cf2807d-9b18-4dcb-a281-e243a70f3b13 tempest-ProjectReaderTests-955233739 None] Created volume successfully. Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Creating offline snapshot 06b81ccd-2a33-4d61-aea0-c92cd9e6799d of volume 96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ae648-e11c-4eb4-acb7-aa650e347247]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:04 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:04 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 Jul 09 17:28:04 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:05 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54" returned: 0 in 0.734s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:05 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:05 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d 1G Jul 09 17:28:05 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:06 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d 1G" returned: 0 in 0.779s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:06 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d Jul 09 17:28:06 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:06 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d" returned: 0 in 0.728s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:06 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d is being set with open permissions: ugo+rw Jul 09 17:28:06 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:06 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d Jul 09 17:28:06 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:07 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d" returned: 0 in 0.622s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:07 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:07 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info Jul 09 17:28:07 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:08 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info" returned: 0 in 0.698s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:08 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info is being set with open permissions: ugo+rw Jul 09 17:28:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:08 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info Jul 09 17:28:08 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:08 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.info" returned: 0 in 0.674s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:08 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:08 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-bdbaeb1e-b1be-4cf2-9724-eef83596d994 tempest-ProjectReaderTests-955233739 None] Create snapshot completed successfully Jul 09 17:28:08 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=59,cinder:INSERT=21,cinder:UPDATE=74,cinder:DELETE=5 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-06b81ccd-2a33-4d61-aea0-c92cd9e6799d-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-06b81ccd-2a33-4d61-aea0-c92cd9e6799d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-06b81ccd-2a33-4d61-aea0-c92cd9e6799d" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-06b81ccd-2a33-4d61-aea0-c92cd9e6799d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Deleting offline snapshot 06b81ccd-2a33-4d61-aea0-c92cd9e6799d of volume 96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] snapshot_file for this snap is: volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7043d052-1a54-4b77-9360-9c9336769eb2]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:09 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:10 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d Jul 09 17:28:10 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:10 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d" returned: 0 in 0.767s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:10 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96fc509d-6cbc-498d-9380-7c3cb6316a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:28:10 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25cfce5-02f4-49fd-b99c-8b22905d79fc]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:10 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:10 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 Jul 09 17:28:10 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:11 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54" returned: 0 in 0.752s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:11 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:11 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d Jul 09 17:28:11 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:12 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d" returned: 0 in 0.701s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:12 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d Jul 09 17:28:12 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:12 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54.06b81ccd-2a33-4d61-aea0-c92cd9e6799d" returned: 0 in 0.607s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-06b81ccd-2a33-4d61-aea0-c92cd9e6799d" released by "_delete_snapshot" :: held 2.913s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" released by "delete_snapshot" :: held 2.933s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=56,cinder:DELETE=8,cinder:INSERT=20,cinder:UPDATE=71 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Created reservations ['4f8e037f-c212-489c-ac75-c32eede5b7a0', '3bdcb5bd-1453-41c9-85f8-1f61ec714900', '9e6d9023-98da-4bb4-8747-8fbab85f3c43', '611f586e-37a1-4a5a-837b-e616f4b0c0cf'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:12 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Delete snapshot completed successfully. Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e8abe403-3ecf-47f4-b061-d9e9e8519506 tempest-ProjectReaderTests-955233739 None] Lock "cinder-06b81ccd-2a33-4d61-aea0-c92cd9e6799d-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:12 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-96fc509d-6cbc-498d-9380-7c3cb6316a54-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "cinder-96fc509d-6cbc-498d-9380-7c3cb6316a54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf3c461-c2ca-492a-84ea-938681bd751a]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:13 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 Jul 09 17:28:13 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:13 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54" returned: 0 in 0.733s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:13 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:13 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54 Jul 09 17:28:13 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:14 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-96fc509d-6cbc-498d-9380-7c3cb6316a54" returned: 0 in 0.646s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-96fc509d-6cbc-498d-9380-7c3cb6316a54" released by "delete_volume" :: held 1.432s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Created reservations ['7cf7f53f-b2d8-4019-b647-a9844a1d974c', 'f5812bb4-1c89-471b-9cf1-a5aae489399f', 'c5a203e2-1af3-410f-a27e-a05df6173c8b', '62fa243c-db41-4d91-b858-991464ba97a2'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:14 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:14 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:14 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:15 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.626s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:15 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Deleted volume successfully. Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-1dd51e4d-398a-46fe-bb06-f9e1598d3f57 tempest-ProjectReaderTests-955233739 None] Lock "cinder-96fc509d-6cbc-498d-9380-7c3cb6316a54-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (029a5dd8-3510-4411-8dec-cd0239da769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270566b2-54e9-46b5-aa7f-32ead948fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270566b2-54e9-46b5-aa7f-32ead948fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303760761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e3a999-16bb-4d7c-a4cd-3045f6b739d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:16Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f78e6ca-8f81-4c9a-964b-e8cc42d9ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f78e6ca-8f81-4c9a-964b-e8cc42d9ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d67a32-b008-4aab-8399-badf91d8029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d67a32-b008-4aab-8399-badf91d8029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e3a999-16bb-4d7c-a4cd-3045f6b739d0', 'volume_name': 'volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab5763-1808-4b27-a0eb-9a731028e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab5763-1808-4b27-a0eb-9a731028e787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de97208e-5efc-4426-bcdb-f489c518d8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:15 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Volume 69e3a999-16bb-4d7c-a4cd-3045f6b739d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0', 'volume_size': 1} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303760761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e3a999-16bb-4d7c-a4cd-3045f6b739d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:16Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Creating volume 69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:28:15 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:28:15 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:15 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 1073741824 Jul 09 17:28:15 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:16 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 1073741824" returned: 0 in 0.765s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:16 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:16 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 Jul 09 17:28:16 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:17 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" returned: 0 in 0.618s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de97208e-5efc-4426-bcdb-f489c518d8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feccbd6-5266-40f9-bee9-ef4e6b9672a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:17 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Volume volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 (69e3a999-16bb-4d7c-a4cd-3045f6b739d0): created successfully Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feccbd6-5266-40f9-bee9-ef4e6b9672a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (029a5dd8-3510-4411-8dec-cd0239da769d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:17 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b1783e4d-c886-446e-9e66-05ee31de3290 tempest-ProjectReaderTests-955233739 None] Created volume successfully. Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Creating offline snapshot f3c258dd-d96e-4f73-aa79-db016df83608 of volume 69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128fde4-98fb-42a2-9071-2080d5ee89fa]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:17 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:17 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 Jul 09 17:28:17 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:18 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:18 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:18 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 1G Jul 09 17:28:18 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:19 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 1G" returned: 0 in 0.752s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:19 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 Jul 09 17:28:19 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:19 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608" returned: 0 in 0.655s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:19 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 is being set with open permissions: ugo+rw Jul 09 17:28:19 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:20 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 Jul 09 17:28:20 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:20 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608" returned: 0 in 0.604s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:20 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:20 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info Jul 09 17:28:20 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:21 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info" returned: 0 in 0.615s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:21 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info is being set with open permissions: ugo+rw Jul 09 17:28:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:21 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info Jul 09 17:28:21 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:21 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.info" returned: 0 in 0.605s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:21 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.029s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:21 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-6c506da2-ec2f-4698-86ee-4418d92833b9 tempest-ProjectReaderTests-955233739 None] Create snapshot completed successfully Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-f3c258dd-d96e-4f73-aa79-db016df83608-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-f3c258dd-d96e-4f73-aa79-db016df83608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-f3c258dd-d96e-4f73-aa79-db016df83608" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-f3c258dd-d96e-4f73-aa79-db016df83608" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Deleting offline snapshot f3c258dd-d96e-4f73-aa79-db016df83608 of volume 69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] snapshot_file for this snap is: volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e57c17-204f-4d81-a919-0827001a5ef6]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:22 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 Jul 09 17:28:22 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:22 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608" returned: 0 in 0.714s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c178a-f78b-41ea-bf2b-5c644d4f46df]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:22 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:22 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 Jul 09 17:28:22 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:23 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" returned: 0 in 0.706s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:23 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:23 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 Jul 09 17:28:23 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:24 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608" returned: 0 in 0.699s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:24 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608 Jul 09 17:28:24 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:24 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0.f3c258dd-d96e-4f73-aa79-db016df83608" returned: 0 in 0.625s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-f3c258dd-d96e-4f73-aa79-db016df83608" released by "_delete_snapshot" :: held 2.826s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" released by "delete_snapshot" :: held 2.845s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:24 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Created reservations ['3d04867d-8c99-499c-b4cb-7dceb00c5a20', 'c760964c-35ba-4eeb-ad34-7d48fa7ed1f9', 'c7a418a6-f99d-4133-bbdd-269d966dd64c', 'c189b55f-ed0a-4fc2-89d0-0f87dc336ea6'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:25 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Delete snapshot completed successfully. Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-f30e2370-6269-4ce2-9bb0-a686df26150a tempest-ProjectReaderTests-955233739 None] Lock "cinder-f3c258dd-d96e-4f73-aa79-db016df83608-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-69e3a999-16bb-4d7c-a4cd-3045f6b739d0-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "cinder-69e3a999-16bb-4d7c-a4cd-3045f6b739d0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" acquired by "delete_volume" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[669706d1-add4-45d7-a803-067c7bfe0acd]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:25 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 Jul 09 17:28:25 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:25 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" returned: 0 in 0.725s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:25 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:26 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0 Jul 09 17:28:26 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:26 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" returned: 0 in 0.614s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-69e3a999-16bb-4d7c-a4cd-3045f6b739d0" released by "delete_volume" :: held 1.393s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Created reservations ['5df1c649-c168-4ba5-9eff-5b6d43e322b1', '570f09ed-ab46-4510-81da-55dc59ce3d2a', 'f826ca8e-dbbf-4962-8043-28ab44729b01', '590223d7-6b05-4f12-ad01-331d51348fde'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:26 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:26 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:26 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:27 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.616s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:27 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Deleted volume successfully. Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-d844165b-065c-42fc-b2e5-4720c19a8565 tempest-ProjectReaderTests-955233739 None] Lock "cinder-69e3a999-16bb-4d7c-a4cd-3045f6b739d0-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (a1c41a70-fe6f-4908-a13a-394e42d38bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b990c89d-4268-422b-9d9a-4ed95311eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b990c89d-4268-422b-9d9a-4ed95311eef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189089059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32682881-17d7-4353-bfea-7f3dc96a5725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:28Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c14c74-8b1a-4e21-9f9d-5667dc8ad418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c14c74-8b1a-4e21-9f9d-5667dc8ad418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c675531a-7122-46c3-8ca1-39f8a3cdaae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c675531a-7122-46c3-8ca1-39f8a3cdaae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32682881-17d7-4353-bfea-7f3dc96a5725', 'volume_name': 'volume-32682881-17d7-4353-bfea-7f3dc96a5725', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77538daf-4579-4985-94f4-a7565b618749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77538daf-4579-4985-94f4-a7565b618749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6149f84e-949f-48fd-8614-84b008ca982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:27 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Volume 32682881-17d7-4353-bfea-7f3dc96a5725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32682881-17d7-4353-bfea-7f3dc96a5725', 'volume_size': 1} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189089059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32682881-17d7-4353-bfea-7f3dc96a5725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:28Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Creating volume 32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:28:27 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:28:27 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:27 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 1073741824 Jul 09 17:28:27 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:28 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 1073741824" returned: 0 in 0.773s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:28 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:28 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 Jul 09 17:28:28 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:29 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725" returned: 0 in 0.618s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6149f84e-949f-48fd-8614-84b008ca982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32682881-17d7-4353-bfea-7f3dc96a5725', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c46a29-5185-4f03-bdf8-bc5f438635b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:29 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Volume volume-32682881-17d7-4353-bfea-7f3dc96a5725 (32682881-17d7-4353-bfea-7f3dc96a5725): created successfully Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c46a29-5185-4f03-bdf8-bc5f438635b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:29 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (a1c41a70-fe6f-4908-a13a-394e42d38bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:29 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-ccf975f1-6dca-415d-a4a4-e72b66f944e2 tempest-ProjectReaderTests-955233739 None] Created volume successfully. Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Creating offline snapshot 3357f50d-125c-415d-899d-662b492df9ff of volume 32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[38352da3-a39d-4f0b-8438-0b039639780b]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:30 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 Jul 09 17:28:30 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:30 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725" returned: 0 in 0.737s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:30 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:30 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff 1G Jul 09 17:28:30 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:31 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff 1G" returned: 0 in 0.756s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:31 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32682881-17d7-4353-bfea-7f3dc96a5725 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:31 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32682881-17d7-4353-bfea-7f3dc96a5725 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff Jul 09 17:28:31 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:32 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32682881-17d7-4353-bfea-7f3dc96a5725 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff" returned: 0 in 0.666s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:32 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff is being set with open permissions: ugo+rw Jul 09 17:28:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:32 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff Jul 09 17:28:32 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:32 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff" returned: 0 in 0.601s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:32 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:32 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info Jul 09 17:28:32 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:33 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info" returned: 0 in 0.606s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:33 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info is being set with open permissions: ugo+rw Jul 09 17:28:33 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:33 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info Jul 09 17:28:33 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:34 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.info" returned: 0 in 0.604s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.042s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:34 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-3e05c20b-ac7f-4130-86e5-3514130fa516 tempest-ProjectReaderTests-955233739 None] Create snapshot completed successfully Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-3357f50d-125c-415d-899d-662b492df9ff-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-3357f50d-125c-415d-899d-662b492df9ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-3357f50d-125c-415d-899d-662b492df9ff" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-3357f50d-125c-415d-899d-662b492df9ff" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Deleting offline snapshot 3357f50d-125c-415d-899d-662b492df9ff of volume 32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] snapshot_file for this snap is: volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ee387-b471-4281-8e7b-f4593d6e67f3]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:34 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff Jul 09 17:28:34 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:34 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff" returned: 0 in 0.702s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32682881-17d7-4353-bfea-7f3dc96a5725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[30732fd1-ab1f-4d64-8c34-6a82366e905d]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:34 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:35 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 Jul 09 17:28:35 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:35 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725" returned: 0 in 0.723s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:35 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:35 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff Jul 09 17:28:35 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:36 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff" returned: 0 in 0.708s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:36 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:36 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff Jul 09 17:28:36 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:37 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725.3357f50d-125c-415d-899d-662b492df9ff" returned: 0 in 0.612s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-3357f50d-125c-415d-899d-662b492df9ff" released by "_delete_snapshot" :: held 2.829s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" released by "delete_snapshot" :: held 2.848s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Created reservations ['bee68b6f-ec5a-4ce2-be73-12948a4d0fa1', '724687c2-94e1-4911-a2fd-05cee65ade6d', 'a42964d9-fade-4bc5-b179-f65b9243840c', 'f7d44a53-c0e7-4c86-ab7a-60e6aadd3a22'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:37 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Delete snapshot completed successfully. Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-0e157fa3-1a11-43de-b00a-47e92542d0e9 tempest-ProjectReaderTests-955233739 None] Lock "cinder-3357f50d-125c-415d-899d-662b492df9ff-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-32682881-17d7-4353-bfea-7f3dc96a5725-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "cinder-32682881-17d7-4353-bfea-7f3dc96a5725-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" acquired by "delete_volume" :: waited 0.015s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[002aff6c-8fa5-448f-b3a2-4575542e1869]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:37 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:37 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 Jul 09 17:28:37 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:38 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725" returned: 0 in 0.717s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:38 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725 Jul 09 17:28:38 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:38 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-32682881-17d7-4353-bfea-7f3dc96a5725" returned: 0 in 0.600s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-32682881-17d7-4353-bfea-7f3dc96a5725" released by "delete_volume" :: held 1.370s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Created reservations ['17d0b120-6bd6-4b74-93a9-a898acb14572', 'fb7b636c-371b-4ffc-9177-70cdec2817b3', '5b3c4cc9-eba0-420f-980f-1de67cf54040', 'b7554262-19a6-48a7-9125-52e3ed4557f3'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:38 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:38 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:38 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:39 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.601s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:39 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Deleted volume successfully. Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-b15ca45d-9fc1-41ac-bc07-62ba9ccd6cdd tempest-ProjectReaderTests-955233739 None] Lock "cinder-32682881-17d7-4353-bfea-7f3dc96a5725-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG cinder.volume.flows.manager.create_volume [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86876) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (c9d44d84-cf95-47ec-b058-1217e8e6c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:39 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16688d4-a1c2-4750-99cd-3c811daf436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16688d4-a1c2-4750-99cd-3c811daf436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802421625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63098d-6d29-42fa-889f-8e762a382967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:40Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcc5665-629b-432a-aab4-b9b553f3fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcc5665-629b-432a-aab4-b9b553f3fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43668f01-569b-4188-b202-c02d236c536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43668f01-569b-4188-b202-c02d236c536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b63098d-6d29-42fa-889f-8e762a382967', 'volume_name': 'volume-7b63098d-6d29-42fa-889f-8e762a382967', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4a043d-e44b-4475-8ea7-0810cb9c9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4a043d-e44b-4475-8ea7-0810cb9c9061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb8da49-de40-41f0-8636-a3602d56b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:40 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Volume 7b63098d-6d29-42fa-889f-8e762a382967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b63098d-6d29-42fa-889f-8e762a382967', 'volume_size': 1} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T15:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802421625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63098d-6d29-42fa-889f-8e762a382967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41051cf3edf64f52b8afce51705e6386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T15:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T15:28:40Z,use_quota=True,user_id='9626da95c95342d68a70931cf95f857e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d2cfbaf-191e-4448-b951-1a3dd93a00fa),volume_type_id=2d2cfbaf-191e-4448-b951-1a3dd93a00fa)}" {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Creating volume 7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Selected osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f as target Quobyte volume. {{(pid=86876) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 17:28:40 devstack cinder-volume[86876]: INFO cinder.volume.drivers.remotefs [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] casted to osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 1073741824 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:40 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 1073741824 Jul 09 17:28:40 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:40 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 1073741824" returned: 0 in 0.772s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:40 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:40 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 Jul 09 17:28:40 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:41 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967" returned: 0 in 0.610s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'} {{(pid=86876) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb8da49-de40-41f0-8636-a3602d56b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b63098d-6d29-42fa-889f-8e762a382967', 'volume_size': 1}' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ec47f6-fc7a-4267-8c1b-4f2f4b842bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 17:28:41 devstack cinder-volume[86876]: INFO cinder.volume.flows.manager.create_volume [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Volume volume-7b63098d-6d29-42fa-889f-8e762a382967 (7b63098d-6d29-42fa-889f-8e762a382967): created successfully Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ec47f6-fc7a-4267-8c1b-4f2f4b842bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86876) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 17:28:41 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Flow 'volume_create_manager' (c9d44d84-cf95-47ec-b058-1217e8e6c32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86876) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 17:28:41 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-191b6c2a-6f18-4331-9efd-f9207de54a6d tempest-ProjectReaderTests-955233739 None] Created volume successfully. Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Creating offline snapshot c3e4bde4-7374-435a-927b-3c34bbd5889d of volume 7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[74887cc8-4b16-49dd-bf45-fab5fbe48cdc]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:42 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 Jul 09 17:28:42 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:42 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:42 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d 1G {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:42 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d 1G Jul 09 17:28:42 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:43 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d 1G" returned: 0 in 0.761s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:43 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b63098d-6d29-42fa-889f-8e762a382967 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:43 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b63098d-6d29-42fa-889f-8e762a382967 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d Jul 09 17:28:43 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:44 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b63098d-6d29-42fa-889f-8e762a382967 -F qcow2 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d" returned: 0 in 0.657s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:44 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d is being set with open permissions: ugo+rw Jul 09 17:28:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:44 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d Jul 09 17:28:44 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:44 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d" returned: 0 in 0.599s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:44 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:44 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info Jul 09 17:28:44 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:45 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info" returned: 0 in 0.609s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:45 devstack cinder-volume[86876]: WARNING cinder.volume.drivers.remotefs [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info is being set with open permissions: ugo+rw Jul 09 17:28:45 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:45 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info Jul 09 17:28:45 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:46 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.info" returned: 0 in 0.602s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:46 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-a162da30-3594-4d51-abc9-0ac20d62fc98 tempest-ProjectReaderTests-955233739 None] Create snapshot completed successfully Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-c3e4bde4-7374-435a-927b-3c34bbd5889d-delete_snapshot" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-c3e4bde4-7374-435a-927b-3c34bbd5889d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" by "delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-c3e4bde4-7374-435a-927b-3c34bbd5889d" by "_delete_snapshot" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-c3e4bde4-7374-435a-927b-3c34bbd5889d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Deleting offline snapshot c3e4bde4-7374-435a-927b-3c34bbd5889d of volume 7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] snapshot_file for this snap is: volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b921ffd-a0b5-4e66-b2cc-67d89eafa1f7]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:46 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:46 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d Jul 09 17:28:46 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:47 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d" returned: 0 in 0.706s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.remotefs [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b63098d-6d29-42fa-889f-8e762a382967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86876) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac0a38-91c8-4a44-ac83-12782f35706e]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:47 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 Jul 09 17:28:47 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:47 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:47 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:47 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d Jul 09 17:28:47 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:48 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d" returned: 0 in 0.737s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:48 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:48 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d Jul 09 17:28:48 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:49 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967.c3e4bde4-7374-435a-927b-3c34bbd5889d" returned: 0 in 0.617s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-c3e4bde4-7374-435a-927b-3c34bbd5889d" released by "_delete_snapshot" :: held 2.858s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" released by "delete_snapshot" :: held 2.879s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Created reservations ['ae1ec4b4-0321-49e1-9d61-fbca464f1af8', 'd8528dcc-a5e8-41a6-bdb6-9491ddf42321', '4d906f46-68e7-4d0c-be01-35349e74a2a2', 'ff7daaab-ae61-485d-9e73-7539ca0941a5'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:49 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Delete snapshot completed successfully. Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-e9793348-2ec0-4019-a854-c5fdf1b9755a tempest-ProjectReaderTests-955233739 None] Lock "cinder-c3e4bde4-7374-435a-927b-3c34bbd5889d-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-7b63098d-6d29-42fa-889f-8e762a382967-delete_volume" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "cinder-7b63098d-6d29-42fa-889f-8e762a382967-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Acquiring lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" by "delete_volume" {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" acquired by "delete_volume" :: waited 0.018s {{(pid=86876) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c84708c-6d6b-456c-90a2-c41749a0a733]: (4, 'qcow2') {{(pid=88397) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 17:28:49 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:49 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 Jul 09 17:28:49 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:50 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967" returned: 0 in 0.712s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:50 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967 Jul 09 17:28:50 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:50 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:50 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984/volume-7b63098d-6d29-42fa-889f-8e762a382967" returned: 0 in 0.632s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:50 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "cinder-quobyte-7b63098d-6d29-42fa-889f-8e762a382967" released by "delete_volume" :: held 1.395s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG cinder.quota [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Created reservations ['bda29027-4c4d-417c-ac57-da4a3bf9fd04', 'b11dd4c4-c9a9-482f-b002-38409b53f30a', '760fb65d-4452-4d41-ae38-8c32e084ad56', '78f8c9f1-97f9-4731-a4d2-4eaa90c1b2f8'] {{(pid=86876) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:28:51 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:28:51 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:28:51 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.618s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:28:51 devstack cinder-volume[86876]: INFO cinder.volume.manager [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Deleted volume successfully. Jul 09 17:28:51 devstack cinder-volume[86876]: DEBUG cinder.coordination [None req-05d404d0-bce3-4302-a783-160eac8fcc3d tempest-ProjectReaderTests-955233739 None] Lock "cinder-7b63098d-6d29-42fa-889f-8e762a382967-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=86876) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f': None} {{(pid=86876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c8a3b420-fc02-4c58-b83b-377ea078666f'] {{(pid=86876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.lockutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 17:29:00 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 17:29:00 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984 Jul 09 17:29:00 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 17:29:01 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 09 17:29:01 devstack cinder-volume[86876]: DEBUG oslo_concurrency.processutils [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cabf13a90676a45ed587ec4f850f0984" returned: 0 in 0.656s {{(pid=86876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 17:29:01 devstack cinder-volume[86876]: DEBUG cinder.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Notifying Schedulers of capabilities ... {{(pid=86876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 17:29:01 devstack cinder-volume[86876]: DEBUG oslo_service.periodic_task [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] Running periodic task VolumeManager._thread_info {{(pid=86876) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 17:29:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread count: 29 {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 17:29:01 devstack cinder-volume[86876]: DEBUG cinder.volume.manager [None req-a4f5d6d3-86b5-4b25-b91e-eca1a9a49c96 None None] thread info: [<_MainThread(MainThread, started 135162848497792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86876) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 17:29:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:SELECT=51,cinder:INSERT=19,cinder:UPDATE=71,cinder:DELETE=3 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 17:29:09 devstack cinder-volume[86876]: DEBUG dbcounter [-] [86876] Writing DB stats cinder:INSERT=19,cinder:UPDATE=65,cinder:SELECT=52,cinder:DELETE=7 {{(pid=86876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}